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ANNOUNCEMENT 

The educational public is entitled to know the reasons for 
establishing a new educational periodical, the place it is designed 
to occupy, and the purpose it is intended to serve. It is true that 
no assumption of a "mission" however happily expressed will 
weigh beside the revealing substance of the periodical itself. 
Like a plank in a political platform it will have merely the interest 
of suspense until practice squares with promise. To the hard- 
headed reader, it may even seem but an artifice to beguile him 
from his customary caution. Yet it is equally true that the 
possession of a clearly conceived plan may reasonably be re- 
quired of those who thus presume to enter a field already so fully 
occupied. 

We feel that we have such a plan. The Journal of Educa- 
tional Research will be devoted to the uses which have been 
made and are capable of being made of the results and methods of 
investigation. It will e naghasize applications rather than abstrac- 
tions, and practice rather than theory. It will not avoid the 
tneoretical altogether, and it will present some technical articles. 
But such articles will be most welcome when they have obvious 
practical implications. EfiSfiarcb. ..for. the. sake of research we 
shall leav eJ[or others. What uses the teacher and supervisor 
have made or may make of the findings of the experimentalist, 
what methods are transferable from the laboratory to the class- 
room and office, what workable means of meeting common needs 
have been developed under actual school conditions — ^these will 
be our chief concern. We shall seek contributions not only from 
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the leaders i|ir .research but also from their followers, the 
practical scH^dl 'people. 

And the.^ool people are likely to contribute handsomely. 

Curreilt periodicals reveal that the ntunber of them who have the 

trXi^]>esearch spirit and the ability to report their findings effec- 

•tivefy is increasing. New types of teacher-training have exalted 

'•*.'a fact basis for instructional and administrative procedure; and 

'•* the introduction of better school records and new means of 

meastu-ement have made such a fact basis possible. What the 

facts are and what comes of them — ^the methods that work and 

the devices that succeed — ^may be told so that others may derive 

friendly lessons for their guidance. 

Theory has outnm practice in our educational writings. 
Since scales and standardized tests began, ten years ago, to 
afford new instruments of precision, a new language has de- 
veloped — a language whose vocabulary and idiom are strange. 
Statistics has come upon the scene, providing a powerful method 
of analysis, but at the same time assuming to a disquieting degree 
the possession on the part of the reader of knowledge and a type 
of thinking which he often lacks. Results are quite generally 
abstract, and "tentative conclusions" are often merely specu- 
lative. Some of us wonder whether all this is necessary — 
whether a writer may not be scientific without being impractical 
or profound without being obscure — whether the time has not 
come when some of these results may be restated in usable form 
— whether we do not now possess the materials for studying 
some problems long enough and hard enough to reach conclusions 
which are fundamental and satisfactory. 

The attempt will, therefore, be to permit practice to catch 
up with theory. The Journal will endeavor to exemplify sound 
theory and it is hoped that its technic will be adequate. But 
we believe its theory and technic will be best exemplified when 
they are employed in the reporting of practical investigations 
and in the formation of practical results. 

In its statistical presentations, the Journal will assay to set 
a standard for clear, simple treatment. Where unfamiliar 
terms or processes are used it will be our policy to define and 
explain them. As a part of this general plan a series of statisti- 
cal articles will appear shortly which will attempt to deal in an 
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understandable way with the terms and processes in current 
usage in educational writings. 

Although the Journal of Educational Research is pub- 
lished for the University of Illinois it is a national magazine. Its 
board of associate editors and its staff of contributing editors 
represent many sections of the country. Manuscripts are being 
accepted for publication and will continue to be accepted regard- 
less of the affiliations of their authors. The National Associa- 
tion of Directors of Educational Research — an organization hav- 
ing bureaus in universities, in city school systems, and in one 
state department — ^has adopted the Journal as its official organ. 
These are evidences that the Journal will by no means be local 
in character. 

* Not only will it aim to appeal to educational people every- 
where but it will also be hospitable to educational questions of 
every type. Indeed its scope in this respect will be as broad as 
education itself. For convenience, however, six major fields 
have been recognized, and corresponding to each is an associate 
editor. 

•^ Leonard P. Ayres will have charge of child accounting ; 
W. W. Charters will give attention to "curriculum analysis and 
derivation; S. A. Courtis will edit manuscripts relating to 
^school supervision and the organization of bureaus of research; 
Walter S. Monroe will deal with educational tests and measure- 
ments ; George D. Strayer will direct the policy of the magazine 
as to educational finance, buildings and building programs, 
records and reports ; and Lewis M. Terman will have control of 
the department of intelligence testing. E. J. Ashbaugh, Secretary 
of the National Association of Directors of Educational Re- 
search, is also an associate editor. He will be responsible for 
the section of the magazine devoted to the affairs of the Associa- 
tion. 

From one point of view no time could be less auspicious than 
the present for launching this venture. The scarcity and high 
price of paper combine with labor shortage and unrest in the 
printing and binding trades to produce a condition bordering 
upon chaos. Many magazines are suspending publication, and 
most others are limiting their output. Under these circum- 
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stances the editors and publishers cannot at present be as liberal 
as they would like to be. 

From another point of view however the occasion is pecu- 
liarly favorable. There are unusual accumulations of good 
material seeking an outlet. On the one hand the facilities for 
publication have been scanty during the war, and on the other 
hand investigations have never been more numerous. Old preju- 
dices have been abandoned. Precedent has meant less than 
ever before. A new sense of values has been created, and time- 
honored processes have been challenged. Some of them have 
stood the test and have been retained ; others have been rejected ; 
while still others have been modified and redirected. Those 
who have been engfaged in this movement have something to 
say, and they have been unable to say it. 

Whether under such circumstances a magazine having these 
avowed aims can meet the needs of the hour will depend not 
only upon the validity of the aims but also upon the steadfast- 
ness with which they are maintained. Believing that our reasons 
are good reasons, that the place we seek to occupy should be more 
fully occupied, and that our purposes are worthy, estimating the 
chances of success or failure, and convinced that success is cer- 
tain if we keep faith with our intentions, we present to the educa- 
tional public this first number of the Journal of Educational 
Research. 

B. R. Buckingham. 

Editor. 



EDUCATIONAL RESEARCH 

S. A. COURTIS AND P. C. PACKER 

Public Schools, Detroit, Michigan 

Many articles have appeared on the subject of educational 
research, but the movement for the use of scientific methods in 
education has grown so rapidly that already much of what has 
been written is out of date. It is fitting, therefore, that in the 
very first number of a journal devoted exclusively to the field, 
the attempt should be made to reformulate in terms of present 
day activities the fimctions of research in education, to define 
its scope, and to describe the organization of an ideal department 
of educational research in a large city school system. 

The point of view of the authors of this article can be most 
readily imderstood if education is conceived as a war waged by 
society to gain control of its own evolution. Many years ago 
the human race, having won certain of the preliminary skirmishes 
against natural obstacles in earth and sky and sea, undertook to 
conserve its hard won gains by creating schools which should 
pass down to the next generation all that seemed to be of per- 
manent value in the experience of the race. That is, at first 
education was a defensive warfare merely. Its chief goal was 
to conserve ; to preserve unchanged.^ 

With the development of human thought and philosophy has 
come a clearer vision. Today men understand as never before 
that the whole spirit and destiny of a people are molded and 
directed by the work done in the schools. Today in education 
society is beginning to conduct an aggressive warfare. Educa- 
tion now aims not only to conserve the best of the past, but to 
improve upon the present and to provide for a progressive future. 
Today the discovery and exact description of the instincts, capaci- 
ties, and tendencies of children, the invention of more efficient 
methods of instruction, the use of more certain methods of direc- 
tion, and the achievement of better forms of organization of 
human energy for carrying forward the collective struggle for 
world betterment are seen by many to be the supreme and persis- 
tent battle in man's ever widening and progressive conquest of 
nature. 

* Well illustrated in China under the old regime. 
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But nature is perverse. In each age she marshals her forces 
anew. Old instincts ever tend to find lawless expression under 
each set of new conditions. Just as the Hollander must repair 
his dikes constantly to keep the sea back from the lands already 
reclaimed, just as further gains make greater and greater de- 
mands upon engineering skill and knowledge, so each age has its 
own educational adjustments to make. The educational warfare 
is a real war. By frontal attack, by surprise raids from air and 
sea, by sapping and mining, the struggle goes constantly on. If 
one age breaks down a feudal system which blocks the way to 
progress, the next develops factory production and industrial 
slavery. The nations have gone to war to make the world safe 
for democracy, but if the schools do not raise a breed of men who 
will put democracy into industry and at the same time make a 
wise use of the increase in the wealth and leisure time that will 
result, the sacrifices of civilization are likely to have been in 
vain. The true battle front of progress in increasing measure 
is to be sought in our schools. 

If now we ask ourselves how a successful general goes about 
it to win his battle, we find that one very important element to be 
considered is the efficiency of his research department. His 
advance listening posts, his scouting parties, his aeroplanes, main- 
tain a continuous survey of the enemy and of all his activities. 
The general must know his opponent's strength and the disposi- 
tion of his forces, he must watch his movements and anticipate 
his attacks. His success depends upon his ability to detect and 
interpret every change in the situation, whether that change 
spells trouble or opportunity. 

Let us call this watchful, continuous collection of facts the 
"survey" function of the intelligence department. It is the first 
of the two great functions of all research. 

It is, however, by no means the only function. For instance, 
suppose the survey work of the intelligence department of an 
army is well done. That is, suppose the commanding officer has 
at his command reliable and reasonably complete information in 
regard to his opponent, and decides upon offensive action. He 
makes his plans, and his men and guns move forward. Imme- 
diately a new type of research work begins. It is now the su- 
preme duty of his intelligence department to keep the general in 
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constant touch with what happens on every front. His plans 
fail here, succeed there. At one part of the line his armies move 
over into new ground and new conditions. At another, the 
enemy develops unexpected strength. If there is to be eventual 
success, the general must be able to modify his plans on the basis 
of the progress of the battle. He must be able to judge at every 
instant how well he is suceeding. Coordination of effort and 
consolidation of gains are directly dependent upon this "judg- 
ment" activity, and this in turn upon the efficiency of his research 
department. 

Let us call this second type of service the appraisal function 
of research. In its essential nature all research, as the name 
implies, is simply the organized, careful, and systematic search 
for facts, but it is well to emphasize the different purposes for 
which research may be carried on. "Survey" and "appraisal" 
merely stress the "beforehand "after" aspects of the relation of 
research to executive action. No matter how great the execu- 
tive genius which plans, or administers, achievement will ever, 
except by chance, be conditioned, on the one hand, by the com- 
pleteness and accuracy of the information upon which plans are 
based and, on the other, by the extent to which they are modified 
to fit actual conditions as these are revealed through executive 
action. 

If now we turn from the battle field to the classroom, the 
exactness of the parallel must be apparent. The superintendent 
as executive head of the school system is constantly called upon 
to plan and to execute. He has need to know the facts ; he has 
even greater need to know the effects of his decisions. In edu- 
cational warfare, we are as yet fighting blindly and in the dark. 
The intelligence service is not well organized. Too often appar- 
ent success at one part of the line appears later as a detriment to 
the general progress. For enduring success there must be active 
and continuous survey work and even more active and more per- 
sistent appraisal of the effects of executive action. 

That is, an ideal superintendent in an ideal school system 
would have as two of his fundamental rules of action, the follow- 
ing: 

1. Except imder the pressure of the need for 
immediate action I will never plan an executive 
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policy or action without a preliminary survey to 
secure the facts which will make my planning in- 
telligent, and 

2. Will never perform an executive act with- 
out immediately taking steps to collect the facts 
which enable me to appraise the effect of the act. 

In such an ideal school system under such an ideal superin- 
tendent, there would be need for a large department of educa- 
tional research and the department would be kept very busy. 

It is not enough, however, to have an intelligent apprecia- 
tion of the two functions of research. Every school man needs 
also a deep-seated conviction as to their importance. Perhaps 
this can be gained best from an illustration from biology. 

In the study of any living organism from a one-celled animal 
to man himself, two types of nervous mechanisms are found ; the 
sensory and the motor. The first transmits inward the stimula- 
tions derived from the environment; the other transmits out- 
ward to the muscles those stimulations which result in motor 
activity. 

Take the case of a cat, for instance. Suppose the control- 
ling intelligence of a cat receives from its department of the in- 
terior a report that supplies are running low; in other words, 
that it is hungry. Suppose further that the cat then directs 
its research department to survey the landscape to secure the 
data upon which to base a plan for obtaining the desired food, 
and that soon the nose reports that a mouse is smelled, the ears 
that a mouse is heard, the eyes that a mouse is seen. 

The cat is now in possession of the necessary facts. She 
formulates a policy; she will catch the mouse. The executive 
orders are issued, the muscles contract, the cat jumps for her 
prey. 

The research department now begins to perform the appraisal 
functions. The nose and ears and eyes measure the distance 
and report that the legs jumped short; that further action is 
necessary if the goal is to be achieved. 

In the meantime, let us suppose that the mouse has been doing 
some surveying on his own account and decides that he has im- 
portant business elsewhere. His executive actions are at once 
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reported by the cat's research agents. Her original plan is then 
modified, the length and rapidity of her jumps are changed until 
the mouse is caught. 

Returning to the educational situation once more, we find that 
in the original one-room private school in early colonial days, the 
master of the school performed every educational function. He 
gathered his own facts, he formulated his own policies, he acted 
upon them, and he appraised the eflFect of his actions, even as 
many one-room school teachers do to this day. But as public 
education grows to be a great mimicipal, or state, or national 
system, this is no longer possible. There has to be division of 
labor and specialization. Today the technic of research de- 
mands special training and undivided attention, both of which are 
seldom possible for the average superintendent. Research func- 
tions must be delegated to a special department. 

An important question to be considered is the magnitude and 
importance of the work of such a department. The answer is to 
be found in our biological parallel. For in nature there have 
been two types of development: plants and animals. In most 
plants, the sensory or research functions have undergone almost 
no development from those of the original call, while the motor 
or executive functions make up the main life activities of the 
plant. Thus a tree is a large and complex organism which 
carries on energetically for many years activities of surprising 
magnitude, yet its sensory mechanism is but little more developed 
than that of the elemental cell from which it has evolved. 

In the animal kingdoms, however, the development of the 
sensory mechanism has paralled the complexity of the structural 
and motor elements. In animals, life itself depends upon the 
proper coordination of the functioning of the two types of 
mechanisms. The plant organization is admirable as a per- 
manent adjustment to a fixed environment, but the animal organi- 
zation permits greater freedom, greater range of action, and thus 
makes possible the attainment of higher levels of progress. 

If now we examine a large school system, such as that of 
New York City, which spends in one year $45,000,000 on its 
schools, and whose superintendent is called upon to direct the 
activities of an army of 35,000 teachers and 900,000 children, 
and if we ask ourselves which type of organization it most 
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resembles, the judgment must be that it is the vegetative t)rpe. 
It is the executive, the administrative organization which has 
developed, not the research or sensory mechanism. The survey 
and appraisal activities upon which executive actions are based 
are carried on today as in the beginning, on the basis of opinion 
merely. It is true a beginning has been made. Since 1912 
there has been a department of reference and research, but the 
total amount spent in New York City during the school year 
1918-1919 for research was less than a tenth of one per cent of 
the total budget. In no sense does either survey of appraisal 
play a vital part in determining executive action. 

What is true of New York City is true also of our educa- 
tional life in general. We have developed education as a vegeta- 
tive and permanent adjustment to a fixed environment, when all 
our experience and all our reasoning proclaim in stentorian tones 
that the environment is not fixed, that the present adjustment of 
education to society is not permanent, that the needs of this day 
and of every day to come is for progress, progress, and yet more 
progress. In other words, the superintendent of any of our 
large city systems has about as much chance of making his 
schools serve adequately the purposes in society which we now 
see they ought to serve, as a cat would have of catching a mouse 
if its research mechanism were dissected out and replaced by the 
elementary sensory machinery of some of the lower animals from 
which the cat has evolved. 

The conclusion is clear and cannot be avoided. Educational 
research is destined to develop until it parallels in magnitude and 
importance the administrative phase of education. Whenever 
the activities of any department attain such size and complexity 
that there must be division of labor, the creation of every adminis- 
trative agent must be paralled by the creation of a corresponding 
research agent, except where the two functions can be combined 
in a single person. Thus the superintendent will necessarily 
combine within himself both the research and the execu- 
tive functions. He must be able to initiate, direct and under- 
stand research work and methods in every field, as well as to 
formulate policies and administer the same in every field. That 
is, the ideal superintendent will be as much the director of educa- 
tional research in his school system as he is now the chief execu- 
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tivc officer. And there is probably no more fitting training for 
him who aspires to be superintendent than several years of 
service in the various fields of research. 

Few school men yet realize that educational research means 
something more than the mere giving of a few trivial standard 
tests in the grades; that education will be a science only when 
scientific attitudes and scientific methods pervade every phase 
of educational work. Perhaps it would be more nearly correct 
to say that few have ever thought of education except in the 
narrow terms of their own special work. It will come as a sur- 
prise to many that in a fully developed school system, educational 
research would be carried on by some fourteen departments or 
divisions, each with a responsible head and each with research or 
clerical assistants. Several of the departments would need a 
large staflF of specialists. 

If we attempt to list these departments in logical order we 
must begin with (1) the department of sociological research. 
The superintendent needs an officer and a properly equipped de- 
partment whose sole duty it to survey society and report its struc- 
ture, its condition, its tendencies, its needs. At present social 
pressure must reach high tension before it operates with certainty 
through the school board and the public press to influence the 
activities of the superintendent. In the future the schools must 
lead, not follow. Educational policies must be based upon ade- 
quate knowledge of the social situation, past, present, and future. 
Nor is it enough that the superintendent make such adjustments 
in organization, studies and methods of teaching as seem to him 
to produce the right effect upon society. There must be an accu- 
rate and scientific appraisal of the effect of the school's output 
upon society.* It is to this sociological appraisal that we must 
look for the final word in regard to every change made in the 
educational process. Survey and appraisal in the field of educa- 
tional sociology are thus the alpha and the omega of education 
itself.* 

'Meriam, J. L. ''Measuring school work in terms of life out of school/' 
School and Society, 5 : 339-42, March 24, 191 7. 

'Hanus, P. H., and Gaylord, H. D. "Courtis arithmetic tests applied to 
employees in business houses," Ediuational Administration and Supervision, 
3:505-20^ November, 1917. 
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The second department would study (2) the methods of list- 
ing and keeping track of the children to be educated (census) 
and of getting them to school and of keeping them there as long 
as their presence in school is profitable. Few cities have any ade- 
quate knowledge of where or imder what social conditions their 
children live.* Still fewer make such studies of social changes 
that they can predict the population shifts in even the immediate 
future. Yet it is upon such data alone that wise purchases of 
school grounds can be made, or an adequate building program 
framed. Similarly, school officers have kept attendance records 
for years, but the methods employed have been so imperfect, and 
so little attention has been paid to the results that even today few 
adequate attendance data exist. Most school men, as well as the 
general public, would be astounded if the real facts in regard to 
absences, transfers, and removals could be presented in graphic 
form. Still less has been done in determining causes of variable 
attendance and in devising corrective measures. Attendance 
research is a wide field that reaches from the home and society on 
the one hand to the classroom and the teacher on the other. Upon 
the solution of certain of the problems in this field, depends 
directly the efficiency of work in several other departments. 

The third field of research covers (3) the problems of organi- 
zation and administration. Because of our present ignorance, 
for many years to come any scheme of organization must, at best, 
be but a compromise between desirable but conflicting ends. In 
the absence of scientific, experimental data, convention is usually 
the determining factor. Changes come slowly. Yet change, 
progress in educational ideals, demand at once corresponding 
change in forms and methods of organization. These in turn 
react upon every form of educational activity." At present the 
research bureaus of many cities are struggling with the problem 
of appraising such recent adoptions as the platoon organization, 
sectioning on the basis of intelligence tests, and the like. Prop- 
erly functioning departments of administrative research would 

*Ayrcs, L. P. Child accountinff in the public schools. (Qeveland Educa- 
tion Survey.) Cleveland: Survey Committee of Geveland Foundation, 1915. 

• Strayer, G. D. and Bachman, F. P. The Gary Public Schools: Organisa- 
tion and Administration. New York: General Education Board, 1918. 
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have supplied experimental data to justify the form of organiza- 
tion adopted and to guide the efforts at appraisal. 

The adoption of a definite educational policy and a definite 
form of organization would seem to demand (4) buildings and 
grounds to correspond. Yet research in this field is little more 
than an idea, a dream.' At Gary, an educational ideal deter- 
mined the form and arrangement of the building and grounds, 
but exceptional as this is in American education, few data can 
be shown which are a real aid in determining the best size, shape 
and arrangement of rooms, halls, etc., to achieve a given educa- 
tional objective. However, a beginning has been made here 
also and standards for measuring existing buildings (an 
appraisal activity) should lead directly to architectural experi- 
mentation. A department of architectural research will be the 
eventual outcome, and a member of the research staff to devote 
his whole time to this field is immediately essential to an adequate 
department of research in a large city school system. 

It is not enough to build schoolhouses educationally adapted 
to a given program. They must be kept in proper condition. 
Lighting, cleaning, ventilating, heating, repairing, etc., condition 
use as much as structure, perhaps more.^ Yet the attention 
given such details in most school systems is of the crudest sort. 
As educational research expands, as the search for the condition- 
ing factors of educational efficiency is pushed farther and farther, 
it is inevitable that the day will come when a special department 
will be created to deal with experimental work of this particular 
kind. Let it be called (5) a research department for mainte- 
nance activities and janitorial service.* 

* No high school building has been designed about the educational activi- 
ties that are to go within it except in the roughest sort of way. For instance, 
a high school building in one of the large cities of the country, constructed 
within the last three years, has lavatory space adequate for 2400-2,600 pupils, 
but the shortage of classrooms is so great the building is overcrowded with 
2,000 students. 

* Brkowitz, J. H. Standardisation of medical inspection facilities. 
(United States Bureau of Education Bulletin No. 2, 1919.) 

•Thomdike, E. L. and Ruger, T. J. "The effects of outside air and 
recirculated air upon intellectual achievement and improvement of school 
pupils : a second experiment," School and Society, 4 : 260-64, August 12, 1916. 
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Qosely connected with buildings and maintenance are (6) 
problems centering around equipment and supplies. The deter- 
mination of what equipment should be purchased, what supplies 
should be used, belongs primarily to the department of instruc- 
tional research, but aact these questions are decided there arise 
problems of purchasing the needed supplies and equipment, of 
distributing them through the system, and of keeping them in 
good repair. Here again the plans of the best of superinten- 
dents and the efforts of the best of teachers and supervisors are 
often seriously handicapped by the failure to give to problems of 
purchase, distribution, and maintenance, the educational atten- 
tion they deserve. Efficiency here does not mean the purchase 
of the cheapest material from the lowest bidder, nor the reduc- 
tion of the expense of distribution or maintenance to the lowest 
possible level. Only the research man whose business it is to 
trace evident results to their ftmdamental causes can appreciate 
the number and importance of the research problems in this 
field. They demand the existence of a divisional organization to 
deal with them.* 

A group of research problems whose importance is being 
recognized more and more widely each year are (7) those which 
have to do with the selection, classification, assignment, and 
promotion of both the personnel of the educational corps, and. of 
the children." As education becomes more and more scientific 
every educational agent, from cleaning women to teachers, from 
stenographers to superintendent, is chosen more and more on the 
basis of fitness for his particular job. Fitness is measurable and 
careful selection by appropriate tests saves the waste and disaster 
caused by the unfit. "Promotion on the basis of merit" presup- 
poses that merit can be determined in some more objective and 
impersonal way than by mere opinion. As yet, however, 
scarcely a beginning has been made. Anyone can enumerate 
more problems which press for solution than the wisest man 
could solve in many years of work. 

'Boston, Mass: Finance commission. Report on the Boston School Sys- 
tem, 1911. 

"Saam, Theodor. "Intelligence testing as an aid to supervision,'' Ele- 
tnentary School Journal, 20 : 26-32, September, 1919. 
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Even more dearly recognized is the need for careful deter- 
mination of the original nature of children. It is evident that 
for the protection of the school, as well as of the child himself, 
each new scholar must be given a searching diagnostic physical, 
mental, educational, moral, and social examination, immediately 
upon his entrance into the school system and that these examina- 
tions must be repeated at sufficiently short intervals to detect 
causes of trouble before they have a chance to produce serious 
effects. The proper classification, assignment, and promotion 
of children are functions so important in education that they call 
for a large and complex organization to perform them in any ade- 
quate manner. The inefficiency of our present machinery is 
daily becoming more apparent. 

It is cMily a question of time before the same department will 
be extended to include the examination, selection, assignment, 
and promotion of teachers, janitors, and every other type of 
educational workers. Not every person who completes success- 
fully a normal training course is fit to be a teacher. Indeed little 
is known about what elements of training and character deter- 
mine teaching ability, while the selection of janitors, engineers 
and other persons whose work has to do with the operation of 
schools has scarcely been recognized as yet as an educational 
problem. In many schools the ideals and refinement of class- 
room work are daily being offset by contacts in basement and 
playground with vulgar and immoral janitors and engineers. 
Each of these has a particular work to do, and the work can be 
done efficiently only by some one who is both trained and adapted 
to the work he has to do. Research problems of the greatest 
importance to society center in this field. 

One of the largest and most complex divisions is (8) the 
department of instructional research, and many are the types of 
problems which would occupy the research men specializing in 
this field. Wherever in the school system there is classroom 
work, there will be found problems of standards, courses of 
study, comparative efficiencies of different types of textbooks, 
equipments, and methods of work. Measurement of the effects 
of supervision is almost a field in itself, as are also the problems 
arising in normal training, teacher training, technical training. 
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etc., the education of typical children, the brilliant, the blind, the 
deaf, the crippled, the mentally deficient, and all the other types 
of children who depart widely from the average child. Every 
one of these fields has its peculiar problems which can be solved 
only by one who is thoroughly familiar with the special technic 
of the field, yet the instructional element is a common factor 
tying all together into a single department. 

Another important division of research is that which has to 
do with (9) problems of health education. It is known definitely 
that physical health conditions mental efficiency, but the Ameri- 
can public is just awakening to the fact that the health habits of 
children, the hours and conditions of sleep, the amount and quality 
of food, the amount of healthful recreational exercise, are vital 
elements in educational efficiency and must sooner or later be 
brought under social control. In the meantime the entire range 
of problems covering the relation between physical and mental 
ability, and physical and mental growth, oflFers almost a virgin 
field in research ! 

Still another distinct field of research is to be found in (10) 
cost accounting and the problems of educational finance. Re- 
search problems of the proper relation between taxation and 
public wealth of relative costs of administration, supervision, and 
teaching, of optimum versus minimum values, and a host of 
similar questions press for solution.^^ 

Mention must also be made of the research problems found in 

(11) vocational guidance and continuation schools; of those in 

(12) adult education and Americanization work just now in 
the public eye; of those connected with the work of (13) pre- 
serving suitable records of the achievements of the school system, 
of preparing reports and statistics for publication, and of con- 
ducting publicity campaigns for the enlightenment and education 
of the community. Finally there must be (14) pure, scientific 
research, the development of new technical methods of measure- 
ment, new tests, new devices, and new organization of existing 
science. There must be the search for the natural laws under- 

" Bachman, F. P. and Bowman, Ralph. The Gary Public Schools: Costs 
for School Year 1913-1916, New Yorn: General Education Board, 1918. 
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lying the teaching-learning process, and there must be also the 
appraisal of the effect of all the research work outlined above. 

One of the problems growing out of the development of 
research departments is that of the relation of such departments 
to the school board, to the superintendent, and to other school 
departments. It is evident that primarily research departments 
are merely special organizations to which the superintendent has 
delegated specific powers and functions and that they are acting 
for him and under his direction and control. However, in as 
much as the superintendent is obligated to make a report to his 
board from time to time in regard to conditions in the school 
system, it should be evident that all possibility of manipulation 
of the results of various research activities should be eliminated 
as far as possible. That is, the research department, on request, 
should report directly to the board. This, however, means 
divided responsibility, while the whole tendency of modern 
thinking in administrative methods is towards fixing responsi- 
bility. The solution of the difficulty is not apparent, but one 
thing is certain ; as research methods gain in effectiveness, con- 
trol would tend to pass more and more into the hands of the 
research men. That is, in the future, an essential qualification of 
an executive officer in any field will be that he have the point of 
view which comes from a thorough grounding in scientific 
methods and that he be able to organize, direct, and utilize, re- 
search activities in his field. If his work becomes so heavy that 
part of it must be delegated, it is the research functions that will 
be retained. Cheap clerical assistants can attend to the details of 
administration if they are given a minimum of oversight and 
direction, but to recognize a problem before it has been recognized 
by others, to frame a policy for dealing adequately with the 
situation, and to appraise the effect of one's policy, calls for 
constructive, creative, effort of a high order. 

Scientific measurement of educational products is about ten 
years old, but educational research in its broadest sense is as old 
as education itself. Nevertheless, all forms have shared in the 
increased vigor and effectiveness which have come from the 
rapid development and statistical technique of instructional re- 
search. Organized research departments in the modem sense 
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may be said to date from the Report of the Committee on School 
Inquiry, New York City, in 1912. Today there are forty or 
more bureaus of research in university, state or city systems, 
and in scores of small schools much research work is carried on 
by superintendents or other school officials. It may be instruc- 
tive to ask how far educational research in any system approxi- 
mates the ideal described above. 

The city of Detroit established a Department of Educational 
Research in September, 1914, but the person placed in charge 
was interested primarily in a single phase of research work — 
namely, instructional research — and the activities of the depart- 
ment were restricted as much as possible to this field. Instruc- 
tional research, however, leads to a study of administrative 
details, and the needs of a big city system produce a steady pres- 
sure for research in every field of work. The development of the 
research staff in Detroit has thus been an erratic and chance 
evolution, rather than the result of careful planning. Neverthe- 
less, in September, 1919, the research forces of the city as repre- 
sented by men specially trained in research methods were: 

1. An assistant superintendent in charge of administrative 
research (buildings and grounds, budget making, organization, 
etc.) 

2. A director of educational research in charge of super- 
visory and instructional research and miscellaneous research 
problems. 

3. An assistant director of educational research in charge 
of research problems in secondary education. 

4. A member of the normal school faculty in charge of re- 
search problems related to normal training and the training of 
teachers in service. 

5. A director" of the department of special education in 
charge of mental testing, the psychological clinic, and related 
problems having to do with classification, assignment and promo- 
tion. 

Each of these men has clerical and other assistants and each 
serves to direct the experiments and research problems of super- 

^ Position unfilled at the opening of school, but the work carried on by 
other members of the department. 
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visors, principals, and teachers throughout the city. In addi- 
tion there are other departments which do much research work, 
as the department of records, publicity and statistics, while the 
Board of Education itself is organizing and directing a general 
survey of school work which makes use of and supplements the 
regular research activities. 

The total volume of research throughout the city is thus very 
large. In the formal measurement of educational products 
alone the program calls for the use of over a million test papers 
during the year, while the informal and practice tests in use in 
the dty will amount to half a million sheets more. All this 
means that in five years the movement for scientific methods has 
so permeated the system and touched the activities of educa- 
tional workers at so very many points that the ideal organization 
and plans sketched above does not lie in as remote a future as the 
conventional school man of the old type is likely to imagine. 
Therefore, the chief purpose of the Journal of Educational 
Research is to bring to school men generally such a knowledge 
of the practical workings of educational research in the average 
school as will hasten the day when the ideal shall have become 
common practice. 



THE USE OF INTELLIGENCE TESTS IN THE 
GRADING OF SCHOOL CHILDREN 

LEWIS M. TERMAN 
Leland Stanford Junior University 

The early experiments with intelligence tests were directed 
chiefly toward the better understanding of the feeble-minded, and 
even their later development has centered largely around their 
use with defectives, delinquents, and other types of mental 
deviates. It is becoming dear, however, that their greatest use- 
fulness will be found in their tmiversal application to school 
children. Binet's "methode de luxe" has been so simplified that 
any intelligent teacher can use it in a way to enlarge greatly her 
knowledge of a given child. The group examination methods 
now in process of development may be expected to add still fur- 
ther to the popularity of intelligence tests as an aid in the more 
accurate grading and in the wiser educational guidance of school 
children. "A mental test for every child" is no longer an un- 
reasonable slogan. 

The Extent of Ixdi\tdual Differences in Intelligence 

Intelligence tests have thrown into bold relief the enormous 
individual differences in intelligence which obtain for any un- 
selected group of children of a given age. These differences are 
no less striking than those long kno^-n to exist in the case of 
height, weight, and other physical traits. The following figures 
illustrate typical individual differences in height, in ability to win 
promotion in school, and in intelligence, and show how similar 
the extent and frequency of the differences are in the three 
respects. 

TABLE L HEIGHT IN C. M., 236 BOYS, AGED 9j4 TO 10j4 YEARS. 

(BALDWIN) 



Height in CM 


119-123 


124-128 


129-133 


134-138 


139-143 


144-148 


149-153 


Percent 


2.1 


11 


22 


29.2 


23.7 


10.2 


1.7 
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TABLE II. GRAE 


►E LOCATION OF 1896 UNSELECTED TEN-YEAR-OLD 
BOYS, SALT LAKE CITY 


Grade 


I 


n 


111 


IV 


V 


VI 


vn 






Percent 


0.7 


4.8 


24 


40 4 


18 <^ 


2.3 


0.2 
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TABLE III. I. Q.'S OF 83 UNSELECTED TWELVE-YEAR-OLD 

CHILDREN ' 



LO 


66-75 


76-85 


86-95 


96-105 


106-115 


116-125 


126-up. 


** ^•••» 


Percent 


5 


15 


20.5 


28 


19.5 


11 


0.8 







•I. Q. b the usual abbreviation for intelligence quotient, which is the quotient of 
mental age divided by actual age. 

TABLE IV. MENTAL AGES OF 263 ELEVEN- YEAR-OLD CHILDREN 



Mental Age 


7 or 
less 


8 


9 


10 


11 


12 


13 


14 


15 


16 or 




more 


Percent 


2.66 


5.32 


9.50 


15.96 


22.81 


14.07 


12.93 


8.36 


5.32 


3.04 







Since the grade of school work which a child is able to do 
depends chiefly upon the level of mental development he has 
attained, such individual differences as those just noted for intelli- 
gence show the weakness of any method of school administra- 
tion which tends to advance the pupil on the basis of chrono- 
logical age. The chronologically old and the chronologically 
young may and often do belong together ; the mentally old and 
the mentally young do not. Investigations show that notwith- 
standing the shifting which takes place at the end of each school 
year, the resulting classification of children has been so far from 
successful that, generally speaking, the lowest 20 or 25 percent 
of pupils in any grade belong mentally in a lower grade and the 
highest 20 or 25 percent in a higher grade. Only the middle 
50 or 60 percent are classified approximately where they should 
be. Usually more than 15 percent of pupils are at least two 
grades removed from the one in which they belong by mental 
age. 

The one criterion of fitness for promotion should be ability 
to meet the requirements of the next higher grade. Actually 
this criterion is lost sight of. The so-called "retarded" children 
are in reality usually from one to three grades above where they 
belong by mental development ; the real retardates are the under- 
aged children who are generally found from one to three grades 
below the location which their mental development would war- 
rant. The dull child is kept at task^ which are hopelessly beyond 
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his ability; the child of superior intelligence lacks the mental and 
moral stimulus which comes from intense application to tasks 
commensurate with his ability. In other words, the problem of 
retardation is exactly the reverse of what it is popularly su[q>osed 
to be. 

The failure of the school to grade children according to 
mental ability is shown by the overlapping of mental ages in the 
different grades. The following figures for certain first grade, 
fifth grade, and first year high school classes are typical. 
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It is seen that not only do first grade children greatly overlap 
those of the fifth grade, and fifth grade children those of the 
first year of high school, but that the brightest child in the first 
grade has all but reached a point in mental ability corresponding 
to the lowest pupil in the high school. The brightest of the fifth 
grade pupils are above the median mental level for the first year 
of hi^ school, and the brighest of the first grade almost reach 
the median for the fifth grade. 



DEsiRABiLrrv OF Tests in the First Grade 
The first grade is the most critical. It is there that retarda- 
tion scores its worst record, for usually about one-third of the 
pupils fail of promotion by the end of the first year. Accord- 
ii^ly, it is especially important that in the first grade the raw 
material with which the school is to work should be correctly 
evaluated. 

By giving Stanford-Binet tests to more than a thousand first 
grade pupils, and by extensive supplementary data and follow- 
up work, Dickson* has thrown valuable light on the factors which 
make for the success and failure of beginning pupils. The 

* See hii forthcoming article in one of the early nnnibers of the Jousmal 
entitled "Intelligence tests of first-grade cbildreB.'' 
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mental ages found ranged from three years to almost eleven 
years. The part played by mental age is indicated by the correla- 
tion, of 0.72 between mental age and the quality of school work 
as rated by the teacher.^ Approximately 90 percent of the 
pupils below a mental age of six years fail to win promotion. 
Since approximately one-third were found to be below this level, 
we seem to have a sufficient explanation for the "piling up" of 
enrollment in the first grade. On the other hand, Dickson found 
nearly 15 percent above the mental age of seven and one-half 
years. Doubtless the large majority of such children could 
quickly be made ready for the second grade, some of them for 
the third. 

Our only requirement of the entering child has been that of 
age, which is beside the point. Our real concern is with the 
mental age. Every child should be tested immediately upon school 
entrance, and those too immature to stand a reasonable chance of 
being able to master the work of the first grade should either be 
sent home or given work of a pre-primary nature. There is no 
excuse for the postponement of diagnosis until the child has be- 
come a confirmed failure. 

Dickson's study is not the only one of this kind. In Council 
Bluffs, Providence, and several other cities, Stanford-Binet tests 
have been given in large numbers to first grade children. The 
results appear to be in essential agreement. The child of six 
and a half to seven years mental age is usually able to master his 
work ; the child of mental age five or five and a half is not. 

Inequality of Classes in the Same Grade 

The success of a teacher is judged largely by the absolute 
standard of work she is able to secure from her pupils. How 
unfair this may be in individual cases is illustrated by the follow- 
ing facts for five first grade classes tested by Dickson. 

"A correlation of ixx) would mean perfect agreement; a correlation of 
0.00 would mean no agreement whatever. A correlation of 0.72 is very high 
for this type of relationship. It means, of course, that in general the greater 
the mental age the better the quality of the work 
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TABLE VI. INTELLIGENCE OF FIVE FIRST GRADE CLASSES 



Room 


Median 
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hHow5H 
(mental) 
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10 
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7-2 


108 


U 


60 


E 


7-« 


112 





71 



The average mental age of Room E was fuUy two years 
above that in Room B, and the median I. Q. 36 points higher. 
One-third of the pupils in Room A, and half of those in Room 
B, were incapable of doing standard first grade work. The lack 
of progress in Room B was so evident that the teacher was in 
despair and the superintendent doubted her efficiency. 

Two fifth grade classes tested by Hubbard yielded a contrast 
no less striking. The pupils of one class, which we will call class 
A, ranged in mental age from less than ten years to more than 
fifteen year ; those of class B, from seven and three- fourths years 
to fourteen years. The median mental age in class A was almost 
twelve years; that in class B hardly more than ten years. A 
twelve-year mental age is normal for the sixth grade, a ten-year 
mental age for the fourth grade. In class A, 44 per cent of the 
I. Q.'s were 110 or above; in class B only 10 percent. In class 
A, 19 percent of the I. Q.'s were below 90; in class B, 44 percent. 
In class A, the median I. Q. was 108; in class B, 91. 

The results of the intelligence tests were abundantly confirmed 
by the corresponding differences between the two classes dis- 
closed by educational tests. Qass A was as far ahead of class 
B in addition, substraction, multiplication, division, reasoning 
ability, and spelling as in mental age. 

As would be expected, these two classes presented an entirely 
different picture. The pupils in class A were interested, alert, 
and above the average in industry ; those of class B were inert 
and unresponsive. The outlook for the two classes is, of course, 
very different. From 15 to 20 percent of the pupils of class B 
will never, with any amount of instruction, be able to do the work 
of the eight grade satisfactorily, and 50 percent are too inferior 
in endowment ever to complete a four year course in the average 
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California high school. In class A not far from 80 percent 
should be able to graduate from high school. 

One might suppose that the teachers of these classes would 
have been keenly aware of the intellectual make-up of their 
groups. They were not, except in the vaguest sort of way. Each 
teacher knew that she has some bright and some dull pupils. 
How bright and how dull was not known. Without an objective 
standard, such as is furnished by mental tests, the teacher can 
only judge a pupil by comparing him with the average of his 
group. 

Range of Intelligence in the First Year of High School 

Noting that one-third or more of the pupils who enter high 
school do not remain to begin a second year of work, Proctor* 
decided to attack the problem at its most critical point by investi- 
gating the abilities of first year students. He gave Stanford- 
Binet tests to about 150 pupils and group tests (chiefly Alpha*) 
to 1,349 others. The mental age scores ranged from barely 
twelve years to nineteen years, approximately 8 percent being 
below fourteen, and about 23 per cent seventen years or above. 
In general, the school marks rose or fell fairly regularly with 
mental age, although there were individual exceptions due to in- 
dividual differencs in application, health, regularity of atten- 
dance, etc. Of the pupils having an average score of B+, not 
one was below the mental age of fifteen. Two-thirds of the 
marks earned by pupils having mental ages below fourteen and 
one-half were C or lower. 

From Proctor's study it appears that the standards of work 
which are maintained in the first year of the average California 
high school cannot be satisfactorily met by pupils with a Stan- 
ford-Binet mental age below thirteen years, and that below the 
mental age of fourteen the chances of success are not good. It 
also appears that children with an I. Q. below 80 rarely succeed in 
entering a California high school, and that those with an I. Q. 

■Sec a forthcoming article by W.M. Proctor, "Psychological tests as a 
means of measuring the probable success of high school pupils." 

*The group mental test that was given to about 1,300,000 soldiers during 
the war. 
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below 90 rardy graduate. A large majority of those who drop 
out have an L Q. considerably below 100. The typical high 
school offers little work which can be mastered by pupils of much 
less than average intelligence. 

Such findings raise the question whether high school stand- 
ards are too high. Certainly if pupils with inferior ability are to 
be retained, the high school will have to do one of two things: 
(1) lower the standard in the present courses; or (2) add other 
studies which are easier while at the same time educationally 
worth while. It may be that we have judged the high school 
too largely by the difficulty pupils encounter in meeting its stand- 
ards for graduation. Proctor found that 70 percent of those \ 
testing below 95 I. Q. failed in more than half of their studies. 
And more than one-third of all children test below 95. A nation 
falls short of the true ideals of democracy which refuses to fur- 
nish suitable training for a third of its children merely because 
their endowment does not enable them to complete a course of 
study which will satisfy the requirements for college entrance. 
High schools at present are in a sense "class" schools. 

Mental Age Standards for Grading 

The average age of school entrance in most parts of the 
United States is not far from 6j4 years. Reckoning on this 
basis, the standard mental age for the different grades would be 
as follows : 

TABLE VII. standard MENTAL AGE 

1 6J4 to 7J^, or approximately 7 years. 

II 7J^ " 8H, " " 8 " 

m 8H " 9H, " " 9 " 

IV 9J^ " lOH, " " 10 " 

V lOii "IIH, " " 11 " 

^ VI 11H"12H, " 12 " 

Vn 12H " 13H, " " 13 " 

Vin 13H " 14J^, " " 14 " 

HighSchoolI 14J^ " ISH, " " 15 " 

Children who are located in accordance with these standards 
arc in the large majority of cases found doing work of average 
quality. If the mental age is much above or below the norms 
just indicated, the school work is usually correspondingly 
superior or inferior. This statement is based upon an analysis of 
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the relation between mental age and school success in the case 
of 1,936 California children. Of these 1,936, 120 were two or 
more years above the grade corresponding to their mental age. 
Only 19 of the 120 were rated as doing anything like satisfactory 
work. Even in some of these cases the teacher's judgment was 
open to question. Among the 1,936, there were 234 located in 
a grade two or more years below the standard for their mental 
age, and nearly all of these were doing average to very superior 
work. 

In setting forth the above mental age standards for the differ- 
ent grades, it is not implied that all pupils should be graded 
rigidly according to mental age or that there should be no over- 
lapping of mental ages in adjacent grades. In the first place, the 
mental age scores yielded by any scale are subject to a certain 
amount of error. In the second place, the child's school success 
is determined in part by factors other than intelligence. All 
these limitations of the mental age method of school grading 
are freely admitted. It is impossible, however, to justify the 
present miscellaneous scattering of mental ages over the differ- 
ent grades. If a child is allowed to progress beyond his mental 
age, the fact should be known and there should be a reason for 
it. The same rule should hold for the child who is not allowed 
to advance as rapidly as his mental age would seem to warrant. 

For several years Stanford University students have investi- 
gated cases in which a marked disagreement was found between 
mental age and the teacher's estimate of the child's intelligence 
or school work. These studies have shown that such disagree- 
ments are oftener due to the erroneous judgment of the teacher 
than to any incorrect verdict of the test. In one group of 238 
pupils, 34 discrepancies worthy of study were foimd. The 
majority of these were not large. In 29 of the 34 cases the 
quality of the school work as rated by the teacher was poorer 
than the mental age would seem to warrant. Where discrepan- 
cies of this kind occured they were ordinarily due to physical 
defects, lack of application, emotional instability, psychopathic 
heredity, or to such traits as timidity and lack of self-confidence. 
Exceptional timidity especially has a strong tendency to cause an 
underestimation of the child's ability. Discrepancies in the 
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opposite direction were usually due either to exceptional mental 
application on the part of the child, or to the effect of vivacity, 
responsiveness, and other favorable personal traits in influencing 
the teacher's judgment. 

One does not need to go far in this line of investigation to 
convince oneself that objective measures of intelligence are 
needed to supplement and also on occasion to correct the teacher's 
judgments regarding the intelligence of her pupils. 

Intelligence Tests of School Laggards 

Notwithstanding the many investigations which have been 
made of retardation in the last decade, the number of school 
laggards has decreased but little. Retardation cannot be prop- 
erly dealt with until its causes are known. The supposed causes 
usually emphasized are physical defects, irregular attendance, 
late entrance, poor home conditions, and lack of flexibility in 
methods of promotion. These "causes" are contradicted by the 
findings of all who have investigated the subject by the use of 
mental tests. Of Dickson's first grade pupils who were chrono- 
logically eight years old or older, 68 percent were below 80 I. Q. 
Of Hubbard's fifth grade pupils who were 12 years old or older, 
64 percent were blow 80 I. Q. Of 174 over-aged children tested 
in the schools of "X" County, California, 106 were below 80 1. Q. 
Anyone who desires additional proof need only test a large num- 
ber of unselected children of a given chronological age, say 11 
years, and note the school progress which has been made by those 
at each mental age. Table VIII is typical. 

A table of this kind offers the best possible evidence of the 
validity of a Binet test as a measure of the child's educability. 

Intelligence Tests for the Gifted 

With the aid of Mrs. Margaret Hopwood Hubbard, we have 
gathered extensive data regarding 59 children, most of whom 
tested above 140 I. Q. The Binet test was taken merely as a 
point of departure for the investigation. 

Most of these gifted children were located in a grade two or 
three years below that in which they belonged by mental age. 
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TABLE VIII. GRADE LOCATION OF 263 ELEVEN-YEAR-OLDS BY 
STANFORD-BINET MENTAL AGE." CORRELATION IS 0.81 
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Many of them have since received one or more extra promotions 
as a result of the test, and all such promotions have been justi- 
ficld by the results. Several were evidently languishing at a 
level of school work which so far failed to command their best 
efforts as to affect unfavorably their whole attitude towards 
school life and school work. 

The study further showed: (1) that these children were 
apparently not below the average in general health ; ( 2 ) that in 
the vast majority of cases the intellectual ability was general 
rather than special or one-sided ; ( 3 ) that their superiority was 
also marked in moral and personal traits; (4) that queemess 
and lack of social adaptability were the exception rather than 
the rule; and (5) that the superiority in most cases showed 
Itself early in life and had been little influenced by formal instruc- 
tion. Follow-up tests of the same children strongly suggest 
that their superiority is likely to be maintained. 

We must multiply indefinitely our "opportimity classes" for 
bright children. Wherever these have been tried they have 
proved an immediate success. Invariably the children are 
touched by new life and inspired with new enthusiasm. Gifted 

■Terman, L. M., The intelligence of school children. Boston: Houghton, 
Mifflin Company, 1919. 
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children are the nation's greatest asset, one that has not received 
a thousandth part of the attention it deserves. 

The I. Q. as a Basis of Prediction 

Mental age is significant because it can be used largely as the 
basis for school grading. The I. Q. is significant for the reason 
that it enables us to predict with some degree of approximation 
what the child's future development will be. 

Of course, no one supposes that the score earned in an intelli- 
gence test is a perfectly accurate index of an individual's mental 
status; or that even if we had a perfect measure of intelligence, 
the ratio between mental age score and age would necessarily 
remain absolutely constant throughout growth. It is generally 
recognized that feeble-minded, and particularly epileptic and 
psychopathic children are subject to erratic changes of I. Q. On 
the other hand, it is equally true that for the large majority of 
children, the Stanford-Binet I. Q. shows a marked tendency 
toward constancy. In the case of 435 I. Q. comparisons of 
earlier and later tests of the same children the coefficient of 
correlation was 0.933 Many of these tests were separated by 
intervals of three to seven years. It was found that the degree 
of constancy was about the same for bright, average and dull 
children. 

There is nothing else about a child as important as the I. Q. 
Knowing this, it is possible to forecast with some definiteness 
what the grade progress will be and what final level of mental 
development will be attained. The probable error of such pre- 
dictions should be established. 

Intelligence Tests in Vocational and Educational 

Guidance 

Vocational guidance usually receives attention only on the 
eve of the child's departure from school. Thus restricted, it 
falls far short of its possible value. At every step in the child's 
progress the school should take account of his vocational possi- 
bilities. 
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We have already seen how f requendy the school errs in at- 
tempting to force children through courses of study which are 
beyond their intellectual capacity, and how futile and discourag- 
ing such efforts are. It is time that the school should ask not 
only what it would like to do, but what it can do, for a given 
pupil. The limits of a child's educability can be fairly accurately 
predicted in the first school year. By repeated tests these limits 
can be determined accurately enough for all practical purposes 
by the end of the child's fifth or sixth school year. 

Vocational guidance is not, and may never be, an exact 
science. Nevertheless, intelligence tests will be of value even 
if they tell us nothing more than that reasonable success in a 
given vocation is or is not compatible with the general mental 
ability which a particular individual possesses. Investigation of 
the ranges of intelligence in the different t)T)es of vocations will 
make this contribution possible. 

Preliminary investigations indicate that an I. Q. below 70 
rarely permits anything better than unskilled labor; that the 
range from 70 to 80 is preeminently that of semi-skilled labor, 
from 80 to 100 that of the skilled or ordinary clerical worker, 
from 100 to 110 or 115 that of the semi-professional pursuits; 
and that above all these are the grades of intelligence which per- 
mit one to enter the professions or the larger fields of business. 
Intelligence tests can tell us whether a child's native ability corres- 
ponds approximately to the median for: (1) the professional 
classes; (2) those in the semi-professional pursuits; (3) or- 
dinary skilled workers ; (4) the semi-skilled workers ; or (5) un- 
skilled laborers; and this information is of great value in 
planning a child's education. 

Suggestions for the Use of Mental Tests 

Teachers themselves should be encouraged to use mental 
tests. All children above the third grade should be given a group 
mental examination at least every other year. All who score 
especially high or especially low should be given also an individ- 
ual examination (Binet, etc.). 

All pupils in the first two or three grades ought to be given 
an individual examination. While the task is large, it is by no 
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means impossible, and the tests at this time wiH be more valtiable 
than at any other period of the child's school career. The aim of 
the school should be to start right with each child. It should 
not be satisfied to proceed in the dark in the hope that mistakes 
will be patched up. 

It is easier to acquire a certain degree of aptness in giving 
mental tests than it is to learn how to interpret their results. 
The teacher or principal cannot give too much study to this part 
nf the problem. 

The mental tests should be supplemented by ratings on 
character traits and by educational tests. Comparison of the 
various kinds of data regarding a given child will prove of sur- 
pa5!(ing interest. 

In conclusion, it is urged that in the management of a school 
or- a M'liool system the principal and the superintendent will find 
lntrlli^rcncc tests an indispensable aid in the analysis of their 
l»tohlcm5, for the simple reason that these problems cannot be 
di>!i»H'iatrd from the quality of material with which the school 
\vork!«. 



A NEW KIND OF SCHOOL EXAMINATION 

WILLIAM A. McCALL 
Teacher/ College, Columbia University, New York 

There are in the United States about six hundred thousand 
school teachers. It is a very conservative estimate that each 
teacher gives on the average twenty examinations a year. This 
makes twelve million examinations each year. The time re- 
quired to construct, give, and score each examination will aver- 
age, say, three hours. This means that thirty-six million hours 
are spent examining pupils. The data just given will suffice to 
show the enormous importance of examinations. Without a 
doubt, they are and will be for some time and may possibly 
always remain the most important form of educational measure- 
ment. Since this is so, it may seem that those of us who are 
interested in educational measurement have, in our enthusiasm 
for constructing and standardizing tests, neglected the tradi- 
tional type of educational measurement. Really, however, this 
has not been neglect on our part, for standardized tests are noth- 
ing but improved examinations. Furthermore we have been 
learning new technics which will in time react to improve the 
making of examinations. The purpose of this article is to show 
teachers how they may make use of one of these new technics 
of scientific testing not only to improve certain kinds of examina- 
tions but also to make examinations a real pleasure instead of an 
onerous task to both teacher and pupils. 

Below is an illustration of a new way to make an examina- 
tion. It is designed to test a pupil's knowledge of certain facts 
concerning the physical features of the United States. We have 
purposely written it hastily in order that it might illustrate cer- 
tain crudities of construction. Any teacher in the elementary 
school could do as well and most teachers could do better. 

The examination as presented here assumes that the state- 
ments whose truth and falsity are to be determined by the pupils 
have been mimeographed so that a copy of the examination can 
be placed in the hands of each pupil. The sample examination 
given below is supposed to have been worked through by a pupil 
and then scored by a pupil or by the teacher. The check, cross 
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L la g«EeraI ihe ssccsain nsOTS 

r=i cast and ircsc Tr::< False V 

Z ifost of the rirers fow aorth Trae False >' 

3. Mt. Mhchell is the highest Doint 

cast of the M£ssissir»oi River Trae False X 

4. Mt- Washinsrton is higher than 

i[t. Mhchea ^ Troe False X 

5. The Catskill Moantains are tn 

Maine True False V 

6. The Cascade Moantains are 

nearer the Pacific Ocean 

than the Rockv Mountains.. True False X 

7. The Rockv Moantains arc 

nearer the Pacific Ocean than 

the Appalachian Mountains. . True False V 

8. The Blue Ridge is in the 

Rocky ^fountains. True False V 

9. There are more active vol- 

canoes in the west than in the 

cast True False V 

10. "Old Faithful" is the name of 

a cyclone which sweeps up- 
ward from Texas into Okla- 
homa True False X 

11. The "Grand Canyon" was cut 

through the Cumberland 
Plateau by the Susquehanna 
River True False V 

12. Pike's Peak is in the Rocky 

Mountains True False V 

13. The Mississippi River flows 

into the Great Lakes True False V 
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14. All the following are tributa- 

ries of the Mississippi River: 

Arkansas, Missouri, Ohio... True False V 

15. The Big Sandy is the biggest 

river in the United States... True False X 

16. The Atlantic Ocean is to the 

east and the Pacific Ocean 

to the west True False O 

17. Canada is to the south and the 

Gulf of Mexico to the north. True False V 

18. The Great Lakes are fivt in 

number True False V 

19. It is easier to sink while 

swimming in the largest lake 
east than in the largest west 
of the Mississippi True False V 

20. The central portion of the 

United States is on the whole 
more level than the eastern 
or western portion True False V 

Number of correct underlinings = 14 

Number of incorrect underlinings = 5 
Number of omissions = 1 

Pupil's score = (number correct) — (number wrong). (A) 
Pupil's score *=» 14 — 5=9 

Let us consider first the reason for expressing a pupil's score 
as the number correct minus the number wrong. Imagine a 
pupil who is absolutely innocent of any knowledge of the physical 
features of the United States. Were such a pupil to take the 
above test and were he to mark every statement, he would accord- 
ing to the theory of chance mark ten statements correctly and 
ten incorrectly. The chances of his guessing right or wrong 
are fifty-fifty or one to one. His score on the above test would 
be: 

Score =- 10 — 10 =» 0. 

In short the pupil's knowledge is zero and the method of com- 
puting his 3fhnri> gives him zero. Suppose instead that he knows 
ten statements and guesses at the other ten. Of the ten guessed 
at he would, according to chance, get five correct and five wrong. 
That is, even though his real knowledge is ten he will show fifteen 
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correct (10 + 5) and fire incorrecL The mediod of computing 
his score brings out his real knowledge. 

Score =15 — 5 — 10. 
A pupil who marks evenr statement correctly makes a perfect 
score» viz: 

Score = 20 — — 20. 

Observe that no account is taken of omissions. Only the 
corrects and incorrects figure in the pupfl*s score. WTien the 
time allowed the pupils to take the test is made short in order to 
test each pupil's rate of work there will, of course, be many 
papers showing several omissions each. In all such cases omis- 
sions should be ignored, just as we have done above, in comput- 
ing scores. Even when the time allowed for the test is ample 
for each pupil to mark every statement, there will still be an 
occasional instance of omission due to carelessness, or a misun- 
derstanding of instructions or a puritanic conscience against in- 
creasing the score by gamble guess-work even when the instruc- 
tions urge guessing. WTien the time is ample for even the 
slowest pupils and when all are instructed to mark every state- 
ment it is much more convenient to compute a pupil*s score 
according to the following formula : 

Score «= (number of statements) — 2 (number marked in- 
correctly ) . . . . (B). 

To derive this formula from the formula marked (A) above, 
note that since there are no omissions, the number of corrects (C) 
plus the incorrects (W) equals the number of statements (N). 
Hence we may write C«=N — W. Substituting this in formula 
(A) gives: 

Score — (N— W)— (W)— N— 2\V. 

If there are 20 statements in the test and if five are marked 
incorrectly. 

Score — (20) — 2 (5) — 10 
Formula (A) gives the same results, i. e.: 

Score =15 — 5 — 10 
Both formulae give identical results provided there are no 
omissions. Formula (A) is basic and should be used when 
there are omissions. Formula (B) should be preferred when 
there are no omissions or when they are present only in negli- 
gible amount Formula (B) is mudi more amvenient The 
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first number is always the same and since the second number is 
twice the total statements marked incorrectly, it is only necessary 
to score and total the errors. 

It is very difficult for some people to believe that such a test 
as we have outlined above does anything more than give the 
highest score to the luckiest guesser. They look with an eye 
of suspicion upon this thing we call chance. Being in a position 
which offered excellent opportunity, namely treasurer of a 
Sunday school, we once tossed pennies for heads or tails fifty 
thousand times. The results came out 25,000 heads and 24,999 
tails. Had there not been a miscount somewhere the two would 
doubtless have come out exactly even. We had occasion to 
watch two summer-school teachers engage in that soul-absorb- 
ing, nerve-racking game of chance called matching pennies. 
Each began the summer with a special bag of one hundred pen- 
nies. They matdied for several minutes daily. The last we 
heard they were still matching pennies and chance had prevented 
either from getting complete possession of the other's one 
hundred pennies. Chance is fatally exact when the pennies or 
the statements in the test are numerous. The opportimities for . 
injustice in scores multiply in proportion as the number of state- l/ 
ments is reduced. Hence there should be as many statements in 
the test as practical limitations will permit. 

The possibility of unreliability of pupil scores is one which 
this sort of examination shares with all other sorts of tests and 
examinations. Last summer we gave a test of this kind to our 
class in educational measurement. As luck would have it two 
visitors were present and were persuaded to take the examina- 
tion along with the rest. There were forty statements in the 
test. The score of one visitor was zero and of the other - 2 (when 
scores are negative they may be considered zero. It is probably 
the accidents of chance which show an individual to know less 
than nothing, though a genuine negative score is possible where 
an individual has been taught errors. ) The highest score made 
by regular members of the class was 36, the lowest score was - 4, 
and the next to the lowest score was 6. The student who made - 4 
admitted that he was not sure of the truth or falsity of a single 
statement and that tmexpected outside demands had until then 
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prevented him from stud>4ng. Even though he was not given 
an F at the end of the summer session and even though the 
cotu^e is not required, he appeared at the college this last Septem- 
ber and registered for the course again. The student who made 
a score of 6 registered late. He had been in the course only four 
or five daj-s. The individual who made the highest score was 
George Mdcher, Director of the Bureau of Research, Kansas 
City, Mo. All were in agreement that he knew more about 
educational measurement than anvone else in the class. 

Ehiring a semester course in educational ps3^ology we gave 
four examinations. The first was of the True-False variety, 
the second was of the traditional What and Discuss kind, the 
third was True-False, and the fourth was traditional like the 
second. Each test lasted about thirty minutes. The half-dozen 
best and poorest students according to the first test remained 
with negligible variation the half-dozen best and poorest in all the 
examinations no matter what the t^-pe. An amusing and pathetic 
incident of the course was the challenge of the poorest students to 
the rest of the class. Those who had been lowest all through 
the term proposed in the last test to displace some of those who 
had been consistently above them. There was a sudden rise in 
the quality of everyone's work, but the lowest remained the low- 
est. These words should not be interpreted as meaning that the 
True-False test is unusually reliable. So far as our inadequate 
data go, there is no reason to suppose that it is much more reliable 
than the traditional examination. 

There are a few suggestions which will help teachers who 
may wish to use the True-False test First, the teacher should 
so construct the test that it will contain approximately the same 
number of true and false statements. A clever pupil may get a 
higher score than he deserves if he discovers there are many more 
true statements than false statements in the test or vice versa. 
Suppose there are many more true statements than false state- 
ments and suppose some pupil discovers this by observing the 
statements that he knows, or by observing the teacher's bias for 
writing true statements instead of false ones. Naturally when 
he does not know what to mark he will mark True thereby secur- 
ing a little larger score than his ability justifies. It is probably 
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by just such utilization of the errors of others that the intelligent 
get through life so much more smoothly than the stupid. On the 
other hand, the teacher should not have exactly the same number 
of true and false statements each time, because this will invite 
clever pupils to count back to see how many more true statements 
have been marked than false statements. Sometimes there 
should be more true statements, sometimes more false statements, 
sometimes the same number of each. A regular plan either as 
to content or arrangement should be carefully avoided. All the 
true statements should not come first, neither should the true and 
false statements be alternated as a regular plan. Let chance 
determine how many shall be true and how many shall be false 
and in what order the true and the false shall come. 

Second, the teacher should be careful to keep out of the test 
all ambiguous statements. Statement number 18 in our sample 
test is somewhat ambiguous. It says: "The great lakes are five 
in number." Since great lakes is not capitalized a pupil might 
very legitimately interpret this to include Great Salt Lake 
and others. It will later be difficult to satisfy this pupil that his 
score should suffer because of the construction he gave this sen- 
tence. If the teacher will study her mistakes in this respect she 
will soon learn how to reduce such ambiguities. As any teacher 
can testify, the danger of ambiguities of wording are not peculiar 
to this test. This type of test does not, however, give a pupil an 
opportimity to reveal just what interpretation he places upon each 
statement. If the teacher follows the procedure of having 
pupils score their own or each other's paper all cases of serious 
ambiguity will be discovered. Statements which are particularly 
flagrant in this respect can be omitted in scoring. 

Third, the teacher should inspect not only this but any sort of 
test from the point of view of just what the test measures. State- 
ment 19 in our sample test illustrates our point. Our purpose is 
to test whether the pupil knows that the largest lake west of the 
Mississippi River contains more salt than the largest lake east of 
the Mississippi. Instead of measuring this we may be testing 
whether a pupil knows that it is easier to sink in fresh water than 
in salt water. Complex wording, unfamiliar terms, the use of 
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negatives, all tend to make the test a linguistic one. Simple, 
brief statements without negatives are best 

Fourth, the teacher may so construct the examination as to 
force pupils to guess wrong due to the power of suggestion. This 
probably explains why statement 15 was marked wrongly. The 
pupil doubtless argued to himself that since the river is named 
the Big Sandy it probably is the biggest river in the United States. 
The influence of having many suggestive statements in the test 
is to make the examination more difficult. It operates to give to 
the pupil who knows nothing at all in the test a large negative 
score instead of a zero score and it penalizes rather heavily the 
pupil who does much guessing, for every time he allows himself 
to be suggested in the wrong direction a point is substracted from 
the score he has already made by what knowledge he has. In 
other words, the suggestive statements make the gap between 
those who know much and those who know little wider than it 
otherwise would be. Whether a pupil should be specially penal- 
ized for allowing himself to be maneuvered wrong is an arguable 
question. There may be situations where it is eminently desir- 
able to determine whether pupils know what they know so well 
as to be able to resist suggestion. But we believe that, in general, 
it is best to avoid suggestive statements. The ideal should be so 
to construct the examination that any pupil who knows absolutely 
nothing about the test will make a score of zero. 

So much for the construction of the examination. How shall 
it be applied ? The best way, as shown by our sample, is to print, 
mimeograph, or otherwise duplicate, the examination, and place 
a copy in the hands of each pupil. But there are numerous 
schools which lack duplicating machines. For teachers in these 
schools some other means for applying the test must be foimd. 
Any one of the following methods may be used. First, the entire 
test may be copied word for word by the pupils and then marked. 
This is tedious and time consuming. Second, the entire test may 
be written on the blackboard by the teacher. Each pupil could 
number a blank page of paper to correspond to the numbered 
statements, and then write True or False after the appropriate 
numbers. The only objection to this suggestion is the incon- 
venience of writing all the statements on the blackboard. Third, 
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the pupils may be asked to copy on blank paper, 1, 2, 3 and so on, 
according to the number of statements. The teacher can then 
read orally statement number 1 and instruct the pupils to make a 
check after the number 1 on their paper if the statement is true, 
but to make a cross if the statement is false. This is easily the 
most convenient way to give the examination. The chief objec- 
tion to this last method is the difficulty some pupils have in appre- 
hending statements presented orally, particularly if they are long 
and complicated. When the statement is presented visually the 
pupil has an opporttmity to go back to it enough times to realize 
his possibility of understanding it. By one or another of these 
methods it is possible for any teacher anywhere to make use of 
this type of examination. 

How should the True-False examination be scored? If a 
copy of the test has been placed in the hands of each pupil, the 
teacher can take an unused test sheet, fill it out correctly, lay the 
correct column of answers beside the pupil's column of answers, 
and quickly mark whether the pupil's answers are correct or in- 
correct. If a copy of the test has not been placed in the hands of 
each pupil, but each has instead written True or False, or made a 
check or cross after the number of each statement, the teacher can 
take a page of paper similar to that on which each pupil has indi- 
cated his answers, copy the numbers just as they are and just as 
they are spaced on each pupil's paper, write after each number 
the correct answer to the statement of that number, place this 
column of correct answers beside the column of pupil answers 
and mark those which are correct and incorrect. This last scor- 
ing method presupposes that pupils have used ruled paper, and 
that each has written his numbers in a vertical column according 
to a particular spacing recommended by the teacher. Last and 
best each pupil can score his own or his neighbor's paper. It is 
better for him to score his own. 

If the method of pupil scoring is adopted, the teacher should 
read the correct answers while the pupil checks his own. If the 
pupil does not have a copy of the statements before him, the 
teacher should read each statement before giving the correct 
answer, in order that the pupil may know what statements he 
got correct or incorrect. When all the pupils' answers have been 
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marked and when all their scores have been computed and 
recorded on their examination paper, the teacher should ask all 
pupils who missed statement number 1 to hold up their hands, 
and then all pupils who missed number 2 to hold up their hands 
and so on. The teacher should make a record of the number of V 
pupils missing each statement, and then collect all papers. 

But why should this sort of examination be given at all? 
Wherein is it superior to the examination method in common 
use? In the first place, the True-False examination permits a 
teacher to cover a wider field of subject matter or a wider range 
of ability per unit of time. It may be made more representative 
of the total field of the pupils' study. In the case of the tradi- 
tional examination the teacher is forced to select a very small 
number of questions. When we were students, almost as much 
of our ingenuity went into divining the kind of questions the y 
teacher would ask as into reviewing. Now that we are teachers 
we have no reason to suppose that this practice has ceased. 
Rivalry among pupils in taking the traditional examination is 
largely a contest in guessing. The True-False examination can 
ask so many questions in a brief time that the only hope of the 
pupil is to study everything everyday and review everything when 
he reviews. Further, this extensive examining is fairer to pupils. 
The pupil has some basis for the time-honored excuse that he was ^ 
so unlucky as to know everything except the particular questions 
asked by the teacher. The new type of examination rules this 
alibi out of court. 

The use of this type of examination is likely to improve the / 
relation between teacher and pupils. The traditional examina- 
tion endangers a pleasant relationship because pupils more or 
less justly suspect that the score they make depends almost as 
much upon their conduct as upon their product. According to 
the pupils' suspicions the teacher uses her control over scores to 
vent a personal spite against the bad boy, and to express her 
appreciation of the "pet." 

There is no question but what the pupils are partly correct. 
The traditional examination is so subjective that it is well-nigh / 
impossible for the teacher to prevent her judgment from being 
influenced by fluctuations in her disposition or from being colored 
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by her affection for the pupil whose paper she is scoring. The 
new examination does away with these prolific sources of un- 
pleasantness. It is so objective that the pupil can see for him- 
self just how well he did. It permits self-scoring, and it con- 
vinces a pupil that the score he gets is the score he deserves. 

The True-False examination is more enjoyable for the pupils. 
"Children cry for it" may be a bit exaggerated, but at any rate / 
they hate it less. It offers an opportimity for a contest where 
the rules are fair, a chance for a larger degree of participation in 
the examination. It is agonizing for a pupil to describe at great 
length a knowledge which he does not possess in the hope that his 
command of English will camouflage his lack of information. 
Here is a question which was asked in a recent examination in 
educational measurement: 

Which three of the tests described by Whipple do you think would 
be of most service in an elementary school, if your school had a psy- 
chologist to apply them ? 

Consider the perspiration it must have cost a student to per- 
petrate this answer: 

The tests described by Whipple embraced most of the difficulties 
that would be embraced in problems of classroom instruction. I think 
his tests embrace a great variety of methods of approach and it seems 
difficult for me to think of just three to whom the presence of a psycholo- 
gist in a school would give help. I would think it would be the tests in 
which knowledge of the workings of a child's mind and its growth and 
development would be most apparent since those not particularly trained 
might focus on others not of this kind. I fear it would be unwise to 
specifically mention just three when the number is so great which would 
fulfill all these requirements. Every teacher to be a psychologist would 
help all classroom measurement work of whatever kind greatly, I know 
since we cannot know of the influence of a test upon any group except 
by the mental reaction produced. 

The True-False examination is also more enjoyable for the 
teacher because the scoring is easy, rapid and automatic when 
she does the scoring, and far more rapid when the pupils do the 
scoring. The pupils cannot well assist in scoring the traditional 
examination, and for the teacher to score forty verbose examina- 
tion papers is time-consuming drudgery. Every moment of the 
time while scoring, the teacher must be profoundly concentrating 
upon what she is reading, for much of the time she must be sepa- 
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rating the chaff from the wheat where the chaff is cleverly painted 
to look like wheat. And along with this is a continual emotional 
strain caused by her resistance to the temptation to underscore 
some and overscore others. 

The True-False examination is more educative to the pupils, r 
The proposition that pupil scoring will relieve the teacher of much 
obnoxious drudgery, does not justify the inference frequently 
made that what is non-educative drudgery for the teacher will 
also be noneducative drudgery for the pupils. On the contrary 
we are of the opinion that the most favorable teaching opportu- 
nity that ever comes to a teacher is the period immediately follow- 
ing an examination. The pupil's interest to know what parts of 
the examination he missed and what he got correct is then at 
white heat. Witness the interested discussion among pupils 
immediately following an examination. It is inexcusable 
neglect of an educational opportunity not to capitalize these pre- 
cious moments for correcting erroneous ideas, clinching right 
ideas, and filling up mental spaces where ideas are not. These 
values can best be realized by having each pupil score his own 
paper and by stopping to discuss points where pupils have trouble. 
Of course not every correct answer indicates knowledge, but the 
pupil himself usually knows when he knows. This examination 
is also more educative, because it is likely to be given more fre- 
quently. The experience of Kirby, Courtis, and others with prac- / 
tice tests shows that a pupil learns more during testing periods 
than during teaching periods. We really teach when we test. 
This examination covering as it can a wide range is an ideal 
method of review. It reveals to the pupils just where their 
difficulties lie. Testing is one of the best ways of teaching. , 

The True-False examination gives the teacher a fuller knowl- ^ 
edge of conditions. The educative value of testing is so great 
that testing should be much more frequent than is now the case. 
If a method of testing is available which involves no drudgery to 
anyone, testing is likely to become more frequent, and this means 
more complete and timely information about the abilities and 
difficulties of the various pupils, and about the successes and 
failures of teaching efforts. We have already suggested that 
the teacher keep a record of the number or percent of pupils 
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missing each statement in the examination. This record will 
show what things have been well-learned or poorly learned, and 
well taught or poorly taught. Also it is a good thing for a 
teacher to check the effectiveness of her teaching. This can be 
done by finding the average of all pupils' scores and by comparing 
this average with the total number of statements in the examina- 
tion or at least the total number of facts the teacher had really at- 
tempted to teach the pupils. If the average score is 20 out of f^ 
a possible 40, the teaching efficiency is 50 percent. 

Finally the True-False examination is a genuine honesty test, 
and shows the beginnings of a technic for measuring in satis- 
factory fashion this valuable character trait. Occasional and 
unannounced rescoring of each pupil's paper by his neighbor will 
catch the persistent cheat. It is better that he be discovered in 
school than in court. His discipline can usually be left to his 
fellow pupils, over whom he was attempting to gain an advantage 
dishonestly. 

We have listed what appear to be the chief advantages of this 
type of examination or any other examination which is similarly 
objective. Most of these claims rest upon logical probability and 
a limited experience and not upon experimental data. This last 
is needed and will follow in time. 

There are some limitations which have not yet been discussed. 
It is claimed first that this examination does not require the pupil 
to demonstrate a power to organize his materials. This is true 
in the sense that the pupil does not describe in tvriting a compli- 
cated mental organization but a statement can be so worded as to / 
require an exceedingly complex mental organization before a ' 
correct answer can be imfailingly given. Consider the mental 
organization that must precede a correct answer to this simple 
statement: "If the trade winds blew east Peru would have lux- 
uriant flora." If it is desired to test a pupil's power to word his *^ 
thought a composition test may be given. 

Again, it is claimed that this examination can test knowledge 
but not skill, knowledge but not the ability to do. Even skills, 
however, can be tested by this type of examination. To reason 
that trade winds blowing east would be warm, would absorb 
moisture from the Pacific, would become chilled in passing over 
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the Andes, would consequently deposit a heavy rainfall for Peru, 
which taken in conjunction with the equatorial climate would 
produce a luxuriant flora, is one sort of skill which this examina- 
tion will test. Mathematical skills and the like which are too 
complicated to describe may be tested in at least two ways. An / 
example or problem may be stated together with an answer. The 
pupil's task will be to determine by working the problem whether 
the answer given is true or false. Or instead, the teacher may 
work the problem on the blackboard for all the pupils and have ^ 
them indicate whether her process was correct or incorrect. 

Finally it is claimed that the teacher needs to know why a 
pupil is unable to answer the question about Peru and its flora. 
The True-False examination does not show just where the pupil's 
reasoning process went wrong or stopped altogether. It is not 
diagnostic. This criticism has some force. An examination 
should be as diagnostic as possible. If a teacher wished to know 
where the pupil's process broke down she could give a subsequent 
more detailed examination of this type. The statement: "The 
trade winds are warm winds" or "Warm winds have a larger 
capacity for water than cool winds," etc., would reveal whether 
the pupils were acquainted with the basic principles, facts and the 
like necessary to reason out the correct answer to: "If the trade 
winds blew cast Peru would have luxuriant flora." 

The traditional examination has certain advantages which 
will doubtless continue its existence. The True-False examina- 
tion is a herald of newer and better types of examinations. But 
even now we have in the True-False examination one that may 
be used by any teacher anywhere to great advantage. 
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HURDLES. A SERIES OF CALIBRATED OBJECTIVE 

TESTS IN FIRST YEAR ALGEBRA 

MURRAY A. DALMAN 

Director Department of Reference and Research, Indianapolis, Indiana 

The purpose of this report is to show how the teachers of 
algebra in one high school solved one of their problems. It is 
because the material is in daily use and the circumstances com- 
mon that the discussion may be of value to teachers searching for 
help in one of their amny difficulties. The method is in continu- 
ous use in the Emmerich Manual Training High School of 
Indianapolis, Indiana — 2l school in which things without value 
are eliminated. 

In common with most mathematics teachers, the teachers of 
first-year algebra in that school were concerned with the great 
number of failures. Because they were excellent teachers, well- 
trained, professionally interested, alive to every problem of the 
department, they were determined to effect a remedy if possible. 
They tried several remedial plans which either did not succeed, 
or were given up on account of administrative difficulties. 

L Qasses were made up on the basis of ability in algebra, 
and pupils were redistributed during the term on this basis ; but 
the crowded condition of the school made this division difficult 
of administration, and the plan was itself of doubtful value. 

2. Qasses were made up of the pupils who were failing. In 
some of these sections, special emphasis was placed upon the 
extension of arithmetic into the generalities of algebra. In 
others an essential minimum of algebra was taught ; but the mini- 
mum varied with different teachers, and the results were widely 
different. 

3. Student assistants from the upper classes were appointed 
to coach the dull and failing and made a brave attempt to bring up 
the laggards, but the results were about the same. 

4. Supervised study classes were instituted and the brighter 
pupils did better. But the number of failures was nearly as 
great as before, and the doubled cost could not be justified. The 
administrative difficulty on account of crowded conditions again 
interfered, 
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from a consideration of the end of the course, what knowledge 
of principles and what skills in manipulation were absolutely 
necessary for successful or barely passing work. The selection 
of principles was a comparatively simple matter, but the second 
step of determining the skills in manipulation required was not so 
simple. It was not easy, for example, to be sure that there were 
no especially difficult points in the requirements — ^no points, that 
is, under any topic which could not be handled by pupils who 
had been successful in the previous topics. 

Then there remained the difficulty of arranging the material 
so that both pupils and teachers would know definitely what the 
minimal requirements were. To solve this problem and also to 
provide successive standards for pupils of successively greater 
abilities, a series of objective tests was planned. 

The standard marking scheme of the school was A+, excel- 
lent, 95 to 100 percent ; A, very good, 90 to 95 percent ; B, good, 
80 to 90 percent ; C, fair or passing, 70 to 80 percent ; and D, 
failure, below 70 percent. Tests were accordingly made out to 
fit the standards, C, B, A, and A+. A chart was made (see 
Figure 1 ) for posting in each classroom so that every pupil who 
passed a test could be publicly given credit for it. Successes 
were indicated by heavy dots placed in certain positions. Such 
an entry in column R, showed that the work to date had been 
passed. No recognition was given a pupil in this column if he 
had failed in the work of a former period and still had that work 
to make up. 

In the succeeding columns were entered for each child the 
grade value (C, B, A, or A+) of the test passed and the number 
of attempts necessary to pass it. The chart provides for four 
attempts under each test. If more than four are required the 
number of attempts may be entered as in the case of the first 
pupil designated as A. S. 

The chart reads as follows: I. C. made a grade of A, or 90, 
passing each test on the first trial ; L. H. made a grade of B, but 
only after three attempts at the C test and four at the B ; etc. 
The record for this class shows that 2 were failed, 7 received a 
grade of C, 8 of B, 5 of A, and 2 of A+. 

To the regular form of chart has been added in this case, 
column M, for the diagnosis of algebraic ability made at the 
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beginning of the term Iwfon*. Oiily thtwe pupils who w-ere in 
attendance at that time have reainls. 

The only instance of complete disagreement between the 
diagnosis and the graile is in tlw case of I. C. For this reason 
her case was investigated. It was foimd that her parents were 
deaf and dumb, and that she had been kept closely at home. She 
had entered school late, and had never had a normal mental 
growth. She failed in all other subjects because she devoted all 
her time to her algebra. 



Jan. 1920 CALIBRATED TESTS IN ALGEBRA 51 

The ninth pupil (B. R.) with a diagnosis grade of 98 reached 
a grade of A+ on the first attempt at each set of tests. 

Figure 2 is a comparative arrangement of sample tests for 
each topic into which the course in first year algebra was divided. 
The tests are given in the vertical columns in the order in which 
the topics are taken up, and in the horizontal columns in the 
order of difficulty in the tests in each topic. By this table it is 
possible to see the minimal requirements for passing, the rela- 
tively greater demands for a B, A, or A+ grade as a whole or to 
compare the relative requirements for each grade in any topic. 

In these tests the passing grade is 100 percent and the exer- 
cises are calibrated with this in view. This avoids questions of 
credit for partial solutions, and differences of judgment on the 
part of teachers, and also makes sure that each pupil who passes 
a test is familiar with all the principles involved and can accomp- 
lish the manipualtions necessary for success in the next topic. 

There was no special endeavor to make all the exercises of 
any given test of exactly equivalent difficulties (although this, of 
course, is approximately true), but rather to make each test cover 
all the principles and conditions underlying the particular topic 
involved. As between tests of the same grade (C, B, A, or A+) 
the effort was to make them equivalent to each other, in propor- 
tion to the increasing knowledge of algebra. 

There was no attempt to make the test for pupils of greater 
ability cover all the points and principles of the C tests although 
this is true in the main, but rather to make them cover the addi- 
tional information and skill in manipulation gained by the pupils 
of greater ability. 

After this preliminary work had been completed, the result 
was tried out in two classes. This trial showed that the analysis 
of difficulty in making the tests was faulty and that the minimum 
set was higher than a proportion of the pupils could reach. This 
was due to the fact that under the traditional scheme of grading 
the teachers had no proper conception of the absolute knowledge 
of the pupils, and that the imaginary standards were never 
reached. In other words measuring on a basis of the accom- 
plishment of approximately three fourths or 70 percent of ma- 
terial of a wide range of difficulty, had led teachers to believe that 
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FIGURE II. THE TESTS, SHOWING THE REQUIREMENTS FOR PASS- 
ING AND FOR HIGHER GRADES IN FIRST YEAR ALGEBRA — 
CLASSIFIED BY TOPICS AND DIFFICULTY 



FiKST Semester— Algebra'I 






Add: 

(1) 

- 2 

- 7 



(2) 
- 6 
9 



(3) 
7 
-11 



(4) 
3 
- 3 



(S) 


s 



6. -2+7-4. 

7. -9+S+l. 

8. 7-4-3- 



Ua-2.b< 
findTthieol: 

1. a-f«b-c 

2. -2aln 

3. 2b» 

4. SMjb 



— 3,c— l,x- — S.y-Oands— 6, 

5. «• - Sa« 

as as 

6. - + - 
3 4 



Subtract: 

(1) (2) (3) 

-3 -9jqr 8 

4 -2xy -7 



(4) (5) (6) 

— ac 2iim 

— 7bc ac lOum 



a-3b+c 
3a- b+5c 



(8) 
2k +3r 
- k+Sm 



9 Vnm 3z+2y— 4s take s+y~2z 
10 Suotiact 3m— r+2p from m+r— Sp 



B 



Add: 

(1) 
-5 

4 
-3 
-1 



(2) 
5 

-S 
4 

-3 




(4) 

6 

-3 

-7 

+8 



(S) 
-8 

-7 

6 

-1 



6. -4-3+5-7. 

7. -^+S-7-2. 

8. 3-9+S-3- 



Gnde of B given to all childxcn who 
C test on third attemi>L 



1. Subtract 2x+s«-S-x« from l-3x«+2x-s« 

2. Fiom la+lb-c take U-|b+ic 

3. From 2a subtnct b+c 

4. Subtract z+2y from 3z— s 



1. The perimeter of a irrtangte it 160 yard*. 
The base is four time the altitude. Find the 
dimensions of the lectan^ 

2. The sum of two numben is 78. The 
greater exceeds the leis by 4. Find the numben. 

3. Solve 2z-(3z+6)-ll-2z and prove 
the result. 

4. Solve S(z— 2)+S -20 and prove the reault. 



1. A farmer wishes to endose a rectangular 
fidd for a pasture, making it 24 rods wide. He 
wanU to make it as kmg as possible, usinc 168 rods 
of wire fendng which he has on hand. How long 
can he make it? 

2. The sum of two consecutive integen is 69. 
Find them. 

3. The sum of the ages of A and B is 70 yean. 
In S yean A will be three times as old as B. Find 
their sfcs. 

z z 

4. Solve -3. Prove. 

2 5 



Divide: 

1. z«-2z-lS by z-S 

2. 6z>+Sz+6by3z-2 

3. as+b* by a+b 



Divide: 

1. 6a+5-23aS+12a>by4a-S 

2. 81m*-l by 3m+l 



Find 



rmd pnmeiscn 

1. 3Z>+I5z+18 

2. m«-a« 

3. 3cf+6cy+3y* 

4. 6a*+22a+12 



factonof: 



5. am+bm+ar+br 

6. l-b» 

7. s!»+z«+s!» 

8. b>+Si 



Find prime facton of: 

1. 16k>-b« 

2. 48s^+72a+27 

3. 100i*-310z+lSO 

4. 3z>-18z+24 



5. 2a<b*-2a«bS+2a>b 

6. bz+by— mz— my 

7. l-27m» 

8. 64i«+a^ 
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FiGUXE 2 — ConUnued 



First Semester — ^Algebra I 



A 


A+ 




Add: 

(1) (2) (3) (4; (S) 
-3 17 -14 12 -IS 
+ 9 -12 13 -10 13 
-8-13 20 7 19 
+12 IS -18 - 6 -12 
-IS -20 -12 -17 10 

6. 19+16-20+12-10- 

7. 20-8-12+16-S- 
S. 19-7+8-4+3- 


Add: 
(1) (2) (3) (4) 

17 36 -12 32 

23 -18 -28 -41 
-12 4S 17 13 

42 -16 -19 -12 
-18 -29 +22 -48 

30 

5. -3S-12+19+1S-27- 

6. lS+19-13+42-34- 


> 
1 


Giade of A given to all children wbo put 
C test on Moond attempt. 


Grade of A+ given to all children who pass 
C test on first attempt. 


I 


1. From 2a>b+3a^-ab>+b* take Sa«+2ab>-2b* 

+4a«b 

2. Sobtiact 3s«+2z*sr-y« from Ss«-2zy«+y« 

3. By bow much does 2z— y exceed z+y? 


1. From the sum of 2a*-a<b+b* and 3a*+2ah>- 

Sb* take the sum of ai+3a>b-2b> and 3a«- 
ab>+4b> 

2. By bow much does 3x —y+x exceed 2x+y—m? 

3. By bow much does exned a+b? 


e 


1. Find the biteger which is such that when 
incicaaed by the first consecutive integer and this 
iom decreased by the second consecutive integer 
the result is 117. 


1. The sum of two couecutive odd integers 
is 72. Find them. 


i 


2. A sum of money amounting to $3.90 con- 

aU. How many of each kind? 

S6&t JgJ^?+^> -'2<^*-2>(*+^> - -3(x-2). 


one-eizth of it by S. Find the number. 

3. A is 62 years old and B is 6 srears old. 
In bow many years will A be five times as old as B. 

4. Solve 6c+10)(x-3)-(x-2)(x+6). Prove. 


Divide: 

1. k«+k%n>+m« by ks+km+m> 

2. S^+iz-l by 3z-l 


Divide: 

1. lSxV-16x^+Sx!»+13xy«-lltV-6y* by x» 
-3xy+2y« 


F 


Find prime fscton of : 

I. fa^$4x«+81 S. ab-bx-ay+xy 

3. Bi%«-81k« 6. 4x«+8x-96 

3. an>*-a<b»+aAy« 7. 24as+6ab-4Sb> 

1 8. 64n^+rHi 

4. 64^ 


Find prime factors of: 

1. 36a«+36ax-40x> S. 8ac-12bc-6af+9bf 

2. 36a«+21ab-30b» 6. 36m>-48a%n+16M 

3. 12Sk«+64in)» 7. 81m«n>-16r« 

4. lSmHi>-6m>n«+3m>n» 1 


? 


7* 


27x« 
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Figure 2 — Continued 



Second Seicester — Algebra II 






1 



Find prtme (acton of: 
I. x«--Sif6 

3. x^+iy-fmi+my 
i. Ji«+Si+2 



5. k>-25ii> 

6. 8-a« 

7. a«+64 

8. c«-l 



6 



Find prime bcton of: 

1. ax— ay— kx+ky 

2. y«-10y«+9 

3. 9y<-6y«+y« 

4. m>-a*+2ab-1>i 



5. 27y«+a« 

6. cV-64€> 

7. 36y«-36y< 

8. 36z>-6z-12 



fiUauUt muat be expreaied in lowest terms) 
«mpl&: 

I— 2a 2a— 2i i— 3x 

t. H + 



2. 



3. 



2ax 4ai 3n 

1 I 2xt 

1+4 1-x x+2 
x-H x+2 



(i+7)(i-2) (x+4)(i+7) 

m>-a> 
4. m— a— 

m+a 



Solve and check: 
2 3 1 

3m 5m 30 
8 12 

m— 5 m+4 
x+5 x+3 69 

4 S~"lOO 



iSx +y - 7 3. Solve by Substitution. 

(3z+y-30 
z-2y--3 l3y+x-34 

2. Solve by Addition or Subtraction. 
|2z-10y-14 
I3z-5y-l 



1. Solve by completing the square x>— 2x«4 

2. Solve by factoring method n*— 7n-*18 

3. Solve xf-49-0 



(All results must be expressed in lowest terms) 
Simplify: 

m y 

1. A 

4(m+y) 3(m-y) 

2a-b 2a+b Sab 



U+b 2a -b 4a*-b> 

1 
3. m>+m+l 



m-1 



4. 



l-a« 



1+a l+a« 



Solve and check: 

Sx 3x 4x>-80 
1. « 

2x+5 2x-S 4x>-25 

x-2 3 

2. -1 

x-3 x-4 



Solve: 



1. 




2. 




(Results must be true to three decimal places) 

1. Solve by completing the square 2Sxs— 20x«>3 

2. Solve by factoring method 2x>— 3x— S«0 

3. Solve x>->5 



Jan. ig20 



CALIBRATED TESTS IN ALGEBRA 



55 



Figure 2— Concluded 



Second Semester — ^Algebra II 



Find prime bcton of: 
1. 6x»-xy-2y« 



2. 6x«-3ax+2mx-am 6. 16k* -1 



S. 2Sa*y»-20a'c«y+4c« 



3. l-64m« 

4. 64k«+8in> 



7. 9x«+3ax-2*« 

8. x»-y*x« 



(An results must be expressed in lowest terms) 
Simplify: 

4z 5z 

1. H 

(S+x)(4-x) (x+2)(x-^ 



a-b 
3. m«+m+l- 
2m 



+ 



a«-b» 



a»+ab+b» a»-b« 
m>-2m+l 

m*— m+1 
a— 2m 



4. 



+ 



(a— 5m)« (a— 3m) (a— 5m) a— 3m 



Solve and check: 

2x+l 2x-l Sx+3 
1. . 

3X-12 3X+1S x»+x-20 



Solve: 



1. 




2. A is four-fifths of 
B's age; but in four 
years. A's age will be 
nve-Mxths of B's age. 
Find their present ages. 



+2 2y+2 



1. Find two consecutive integers whose pro- 
duct is 240. 

2. The sum of a number and its reciprocal 
65 

b — . Find the number 
28 



A+ 



Find prime factors of: 

1. 25m«-9y«-|-12ay-4a« 

2. 2x«-8x 

3. 25m«-|-50m%-|-25a* 

4. 6b«c»-25bc-|-14 



5. mx— mk-H2mv 

— ax— 2ay4-ak 

6. y«+3y«-|-4 

7. llx»-|-x-10 

8. 27y«+64m« 



(All results must be expressed in lowest terms) 
Simplify: 

2-|-a« 3a-|-l Sa-1 



1. 



a«-9 (3-a)(2-a) (a-2)(a-|-3) 
a+b a-b 2b« 



+ 



+ 



3. 



a»+ab+b« a»-ab-|-b» a«-|-a«b«-|-b« 
m«-3m-|-9 m«-|-3m-|-9 



m»-27 



m»-|-27 



1. A has 852 and B has $68. After giving B 
a certain sum, A has left only one-half as much 
money as B then has. What sum did A give to B? 

2. A's age is one-third of B's age, and 6 years 
ago it was one-fifth of B's age. Find their present 



Solve for x and y: 
ibx-ay-b« 

^ax— by"a> 



2. The sum of two (Ugits 
of a number is 14; and it 18 
be subtracted from the num- 
ber, the remainder equals 
the number obtained by 
reversing the digits. Find 
the number. 



1. Find the base and the altitude of a triangle 
whose area is 432 square inches, if the base exceeds 
tw'ce the altitude by 12 inches. 

2. Find the dimensions of a rectangle whose 
area is 720 square feet if the simi of the oase and 
altitude is 54 feet. 



3 



en 



E 



f 
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pupils who were barely passing had learned a great deal more 
than they really had, if measured in terms of absolute and not 
relative knowledge. Requirements had to be changed and tests 
rewritten to conform to classroom conditions. 

After many trials, reducing the difficulty of one test increas- 
ing that of another, a set of tests was perfected as far as the 
limitations of two classes and two teachers would allow. The 
number of tests for each topic was fourteen, five C, four B, three 
A and two A+ tests. This number was f oimd to be enough to 
cover all but the most exceptional cases, that is, no pupil who 
attempted five C tests and failed, was likely to succeed on the 
sixth. 

The next endeavor was to show the value of the ''Hurdle 
Scheme" in comparison with the traditional type of work. This 
was done in experimental and control groups. The test method 
easily proved its merit by the reduced number of failures and the 
increased knowledge of algebra. Although the C tests seemed 
ridiculously easy, the control groups could not pass them, show- 
ing that the knowledge of the pupils was not uniform or absolute 
but rather haphazard or hazy, that is they could do much more 
difficult work in which some principles were involved but could 
not do work which involved all of the principles demanded in the 
"minimum essentials" course. 

The value in the use of "Hurdles" is also shown by a compari- 
son of the final grades for groups in which the hurdles were 
used with those for the control groups in which they were not. 
Table I shows the distribution of grades D, C, B, A, and A+ 
among 63 pupils remaining to the end of the term in three sec- 
tions in which the hurdles were used. Table II shows the same 
facts for 229 pupils in twelve sections in which the hurdles were 
not used. 

Table III shows the percent of pupils receiving each grade in 
regular classes and in classes using the hurdles. The per- 
cent of failures is much greater among the regular classes as is 
also the percent of those receiving the lowest passing mark. A 
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TABLE I. PUPILS IN 3 CLASSES IN ALGEBRA II IN WHICH 

"hurdles" were used, classified by grades RECEIVED 

SCHOOL REPORTS, FIRST SEMESTER, 1915 





Class 


Total 


Number Receiving 




D 


C 


B 


A 


A+ 


I 


22 


1 


1 


12 


7 


1 






n 


22 





7 


8 


5 


2 






in 


19 


3 


6 


7 


2 


1 






Total 


63 


4 


14 


27 


14 


4 



TABLE IL PUPILS IN 12 CLASSES IN ALGEBRA II IN WHICH 
"hurdles" WERE NOT USED, CLASSIFIED BY GRADES RE- 
CEIVED SCHOOL REPORTS, FIRST SEMESTER, 1915 



Class 


Total 


Number Receiving 




D 


C 


6 


A 


A+ 


I 


16 


1 


13 


2 












n 


16 


2 


8 


6 












in 


20 


3 


11 


6 












IV 


18 


1 


7 


10 












V 


23 


1 


14 


6 


2 








VI 


18 


1 


12 


5 












vn 


22 


4 


11 


4 


3 








vm 


20 


3 


8 


5 


2 


2 






DC 


17 


4 


3 


7 


2 


1 






X 


20 


4 


10 


6 












XI 


19 


4 


11 


4 












xn 


20 


6 


6 


7 


1 








Total 


229 


34 


114 


68 


10 


3 







decidedly greater proportion of the pupils in classes using the 
hurdles received the higher ratings. 
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TABLE TU. PERCENT OP PUPILS RECEIVING EACH GRADE IN 
REGULAR CLASSES AND IN CLASSES USING "HURDLES" 



Gnde 


ReguUi 
dasscs 




1 


2 


3 




U.85 
49.78 
29.69 
4.37 
1.31 


























100.00 









The facts of Tables II and III have been graphically com- 
bined in Figure 3. These graphs show the percent distribu- 
tion by grades of the three classes using the hurdles and the 
twelve not using them. The near approach of Curve II to the 
normal and the skewing of Curve I to the right shows the advan- 
tage of the use of hurdles. 
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FIGURE 3. THE DISTRIBUTION OF GRADES IN THREE CLASSES IN 

WHICH "hurdles" were USED, (CURVE II) AND IN 

TWELVE CLASSES IN WHICH THE "hURDLES" 

WERE NOT USED, (CURVB l). 
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TABLE IV. THE PUPILS IN ELEVEN CLASSES, ALGEBRA II, IN 
WHICH "hurdles" WERE USED, CLASSIFIED BY GRADES 

RECEIVED SCHOOL RECORDS — ^SECOND 

SEMESTER, 1916-1917 





Total 


Number Receiving 


Class 


D 


C 


B 


A 


A+ 


I 


19 


3 


3 


6 


6 


1 






n 


20 


2 


7 


7 


4 








ni 


25 


4 


4 


16 


1 








IV 


14 


2 




9 


1 


2 








V 


17 


2 


3 


3 


7 


2 






VI 


20 


2 


7 


4 


4 


3 






vn 


21 




3 


11 


6 


1 








vra 


19 




6 


4 


8 


1 








DC 


15 


4 


1 


5 


4 


1 






X 


21 


4 


4 


9 


4 








XI 


15 


1 


2 


7 


4 


1 






Total 


206 


24 


40 


81 


49 


12 







Table IV shows the distribution of grades in eleven classes 
in which the hurdles were used after their introduction through- 
out the department. These classes and the twelve used in Table 
II were chosen because they were taught by the same teachers. 
While the results are not as satisfactory as those shown in 
Table I they are much better than those in Table II. 
The percentage distribution is as follows: 

D 11.65 

C 19.42 

B 39.32 

A 23.79 

A+ 5.83 

Total 100.01 

Figure 4 shows in graphic form the facts of Table IV. The 
divergance from normal lies in the fact that the curve is bent 
downward at the C and upward at the D line. Some of the pupils 
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who should have had C were evidently not reached and became 
D's. 



_i__ „ 



FIGURE 4. THE PERCENT DISTRIBUTION BY GRADES OF THE 

PUPILS IN ELEVEN ALGEBRA CLASSES IN WHICH 

THE "hurdles" WERE USED 

Table V shows for 16 classes of one semester the mmiber 
gaining in rank or losing in rank in the successive topics. Under 
ideal conditic»s, with an ideal set of tests, the pupil who could 
achieve A+ in the first topic would achieve A+ in all topics and 
the pupil who was barely able to make C in cHie topic should be 
bardy able to make C in all the others. 

The tests are far from ideal and the conditions were only 
normal but the deviations in rank as pupils passed the successive 
tests were not many as evinced by the table. The tests on addi- 
tion of fractions were slightly more difficult than any of the 
others because seven more lost than gained in rank and the tests 
Ml fractional equations were slighdy less difficult because nine 
more gained than lost. Of the totals eight more gained than lost 
but this number is so small that as in the case of the gains or 
losses in particular topics, the irregularities of attendance, and 
interruptions would always cause that amount of deviation. 

The discussion of methods has no jAatx, theoretically, tn any 
course of study, but, practically, the administration of a course 
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or the method of conducting the work is an integral part of the 
course. The "Hurdle System" was devised so as to interfere as 
little as possible with the usual methods of the recitation. It does, 
however, emphasize attention to individuals. On this accotmt, 
therefore, a brief explanation of a change from the ordinary 
method may be desirable. 

TABLE V. NUMBER OF PUPILS WHO GAINED OR LOST IN RANK IN 

CLASSES OF ALGEBRA II 

Number of pupils in 16 classes remaining to end of term 380 

Number making same grade in all tests of series 240 

Number making gain in rank or loosing in rank or both. . . . 140 

Number making gain in rank 80 

In factoring 18 

In addition to fractions 18 

In fractional equations 26 

In simultaneous equations 18 

In quadratic equations 7 

Number loosing rank 72 

In factoring 15 

In addition of fractions 25 

In fractional equations 17 

In simultaneous equations 8 

In quadratic equations 7 

The teacher takes up any new topic as "Addition of Frac- 
tions" in any way he thinks best. As soon, however, as he 
thinks that one third or more of the class have a sufficient knowl- 
edge of principles and skill in manipulation, he gives a C test. He 
then has two groups and the difficulties of each child in the lower 
group are shown by his errors on the test. These points can be 
emphasized in any exercises the class is engaged upon, and class 
work goes on as usual. After an interval another C test and a B 
test are offered. Then there are three groups but the lowest 
group is very small and it is possible to give them individual 
attention and supplementary calibrated lists of exercises laying 
specif stress upon the shortcomings of each pupil. The regular 
work, however, is continued, for the slow pupils can understand 
the solution of difficult exercises although they may not be skillful 
enough to manipulate the quantities successfully. On the one 
hand, the bright pupils are intent upon getting sufficient know- 
ledge and skill to enable them to pass the higher tests which they 
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know will be offered as soon as they are ready for them. On the 
other hand, the slow pupils while they are doing tasks adapted to 
their skill are, at the same time, profiting by the teaching of the 
more capable pupils. For the latter are working on similar, 
though more difficult, material In other words their exercises 
involve the same principles which the slower children are also 
attempting to apply. 

Teachers soon develop a technic of handling pupils in 
groups, and since these groups are mechanically sorted out for 
their attention, they can arrange materials and methods to fit the 
needs of each group. This is especially easy since each group 
has advance notice or a sample of the requirements for the next 
test. 

The chart on the wall keeps up the enthusiasm of every child 
and cures many cases of laziness because of the spirit of competi- 
tion it engenders. The lazy pupil cannot hold the esteem of his 
fellows by an occasional show of brilliance and at the same time 
depend upon it to get him a good mark from the teacher at the 
end of the term. His record shows. He gets what he earns. 



^ Tidy MAN, Willard F. The teaching of spelling. (School monograph 
series.) Yonkers-on-Hudson, N. Y. : World Book Company, 1919. 
178 pp. 

The literature giving accounts of educational research which is appear- 
ing in increasing volume in our educational periodicals and in miscellaneous 
publications is making the demand for well-organized summaries a pressing 
one. An attempt to meet this matter has been made in the case of spelling 
by Dr. W. F. Tidyman in his recent monograph on the teaching of spelling. 
He states that his purpose is "to bring together from all sources the more 
reliable and pertinent facts of the teaching of spelling and to present them in 
their relation to the practical problem which the teacher has to face every 
day in the classroonL" Aside from the fact that teachers and superinten- 
dents generally do not have access to the original sources, it is very difficult 
task to translate the results of research into guiding principles and rules for 
schoolroom practice. Therefore, the writer of this monograph has rendered 
distinctive service in bringing together some of the more reliable and per- 
tinent facts in the field of spelling. 

The table of contents is a good index of the topics treated : 

CHAPTER 

I. The Selection and Qassification of Words 

II. Preliminary Testing for Word Difficulty 

III. The Psychological Basis of Spelling 

IV. The Presentation of Words 

V. Independent Study and Reviews 

VI. The Prevention and Treatment of Errors 

VII. Testing 

VIII. The Measurement of Spelling Efficiency 

IX. Factors Affecting Spelling Efficiency 

APPENDIX 

A. Spelling Plans 

B. Minimum Word List 

BIBLIOGRAPHY 

spelling Material 

The Ps)rchology of Spelling 

The Pedagogy of Spelling 

Scales and Standards Tests 

Factors Affecting Spelling Efficiency 

General Studies — Summaries, Discussions, etc. 

One of the most valuable features of the book is the bibliographv. In 
addition to being classified under the headings given above, there are help- 
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ful subdivisions. For example, under die general heading of spelling 
material, the scources are grouped under the following sub-topics: 

Word lists, difficult words, common misspellings, classes of errors, grad- 
ing, grouping, homonyms. 

Under the pedagogy of speOing we find the following subdivisions : 

Syllabification and diacritical marks, meaning, divisions, method of pre- 
sentation, spelling plans, the value of rules, transfer, dass study versus inde- 
pendent study, spelling consciousness, correc ti on or errors. 

Such a grouping of references for particular topics will be very help- 
ful to anyone who wishes to consult the original sources. 

A net total of 114 sources is mentioned. Only a very limited number 
of unpublished theses are included. It is probably too mudi to expect of a 
writer to include in such a summary such sources but tfiere is a considerable 
accumulation of unpublished reports some of which are very valuable. For 
the most part, they have not been listed and extensive and persistent corres- 
pondence would be required to unearth them. In comparison widi some odier 
bibliographies on spelling, it appears that sources in die general field of 
psychological research have not been completely canvassed. This shortcom- 
ing is, however, offset by the inclusion of a number of references from 
foreign publications. 

The style of the book is simple and teachers will find it readable. Few 
direct citations to sources are made and interwoven with the summary of the 
results of research is much of the writer's pedagogical theories and beliefs 
in this field. Use is made of paragraph side headings in italics as well as fre- 
quent centered headings. This makes it easy to locate in the chapter the 
discussion of even minor topics. At the end of each chapter there is a simi- 
mary consisting of numbered statements which are in the form of principles 
and rules for the teaching of spelling. 

Students in the field of education will be disappointed that the writer 
has not given specific citations to the sources on which his principles and rules 
are based. However, this omission will not be missed by die general reader. 
In general, the writer does not discuss in a critical way die accounts of 
research which he uses. However, a critical comparison of analyses would 
not be in keeping with his announced purpose. The book will meet a real 
need and Dr. Tidyman is to be commended upon his effort 

W. S. M. 

Lyon, Leverett S. A survey of commercial education w the public high 
schools of the United States, (Supplementary Educational Monographs, 
V. 3, no. 5, 191 9.) Chkago: University of Chicago Press. 62 pp. 

Commercial education in high schools has been slow to accept scientific 
procedure in its reorganizatk>n. Developing as it did immediately out of the 
practices of business colleges, commercial education has been more or less 
formal and routine in character. One of the first steps in a progressive modi- 
fication of traditk>nal practices b a thorough-going study of exbttng practices, 
together with a careful analysis and evaluation of these practices in the light 
of modem social needs. 
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Mr. Lyon's monograph reports the results of a careful investigation of the 
practices in the commercial departments of one hundred thirty-six high schools 
in different sections of the country. Among the problems which were studied 
are the following: the percentage of students in commercial courses, the 
length of commercial courses, the kinds of subjects included in these courses, 
and the English requirements. Special consideration is given to the ''social- 
business" subjects. The fact is emphasized that there is genuine need for 
agencies through which much-needed text and reference material can be 
organized and published. In a final chapter entitled 'Tlans and Policies in 
Secon''^.ry G>mmercial Work," Mr. Lyon points out the need for a study of 
the purposes of high school commercial courses in "modem functionalized 
society." In addition, he shows the need of scientific surveys and investiga- 
tions to secure the facts on which to base radical changes in current practices. 

Although Mr. Lyon's stuy is by no means exhaustive, it represents the 
most comprehensive and scientific investigation of its kind which has been 
made in the field of commercial education. It should be read by superinten- 
dents, high school principals, and all teachers of commercial education. 

W. S. G. 

HoBSON, Elsie Garland. Educational legislation and administration in the 
state of New York from 1777 to 1850. (Supplementary educational mono- 
graphs, V. 3, no. I, 1918.) Chicago: University of Chicago Press. 267 pp. 

In this monograph. Miss Hobson has analyzed and summarized the educa- 
tional legislation of the state of New York from 1777 to 1850 in terms that are 
intelligible to the average reader. The following topics receive considerable 
emphasis in her discussions: formative influences; dual system of school 
control; education under regents; the common school system; special legisla- 
tion for cities; support of education; and education of special classes. The 
appendix contains complete lists of titles of the legislative acts with exact refer- 
ences to the sources where each may be found; abstracts of the charters of 
colleges, academies, and other types of institutions; abstracts of legislation 
concerning school lands and funds; common school acts and other similar 
data. 

Miss Hobson has investigated a field in which much research work is 
necessary. It is obvious that an exact knowledge of educational legislation 
during the early periods of our history is necessary, if we are to understand 
the evolution of the various public school systems. It is also evident that this 
type of educational history will supply facts for interpreting and modifying 
present school practice. Furthermore, it will aid greatly in throwing light on 
our social, religious, economic and political history. From various points of 
view, therefore, this monograph is a valuable contribution to the history of 
American education. 

W. S. G. 

PUBLICATIONS RECEIVED 

Baylor, Adelaide Steele, and Colbert, Emma. Young Americ(^s First Book. 
New York: Century Company, 191Q. 167 pp. 
4- Betelle, James O. Checking Schedule for Projected School Buildings, 
Milwaukee : Bruce Publishing Co., 1919. 32 pp. 
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Bctts, Gtorzit, Herbert How to Teach Rehgum, Primci^Us and Methods. 

New York: Abingdon Press, 1919. 22^ pp. 
Bexell, J. A. First LessoKs in Busimess, PhiUdelphiai : J. B. Lippincott G)., 

1919, 174 pp. 
Bronner, Augusta F. The Psychology of Special Abilities amd Disabilities. 

Boston : Little, Brown and Company, 1919. 269 pp. 
Chamberlain, Arthur Henry and Chamberlain, James Franldin. Thrift and 

Conservation, How To Teach It. Philadelphia: J. B. Lippincott Co., 

1919L 272 pp. 
Cubberley, Ellwood P. Public Education in the United States. Boston: 

Houghton ^fifflin Co., 1919. 517 pp. 
Dewey, Eveljm. \ew Schools for Old. New York : E. P. Dutton and Co., 

1919- 337 pp. 

Elsom, J. C. and Trilling, Blanche M. Social Gamus and Group Dances. 
Philadelphia: J. B. Lippincott Co., 1919. 258 pp. 

Elson. William H. and Keck, Christine M. Junior High School Literature. 
Chicago: Scott, Foresman and Co., 1919. 624 pp. 

Field, Walter Taylor. Readings from English and American Literature. 
Boston: Ginn and Co., 1919. 612 pp. 

Gtiitteau, \Vm. Backus. Our United States. New York: Silver, Burdett 
and Co., 19191 680 pp. 

Hamilton, Samuel Essentials of Arithmetic, Book /. New York: American 
Book Company, 1919. J92 pp. 

Hamilton, Samuel. Essentials of Arithmetic, Book 11. New York : American 
Book Company, 1919. 460 pp. 

Haney, James Parton. Industrial Art, Its Tenets and Teaching. New York: 
Prang Company, 1919. 37 pp. 

Jackson, Bennett B., Deming, Norma H., and Bemis, Katherine I. Thrift 
and Success. New York: Century Company, 1919. 288 pp. 

Laing, Graham A. An Introduction to Economics. New York: Gr^^ Pub- 
lishing Company, 1919. 454 pp. 

Lefferts, Walter. American Leaders, Book I. Philadelphia: J. B. Lippin- 
cott Co., 1 919. 329 pp. 

Lefferts, Walter. American Leaders, Book II. Philadelphia: J. B. Lippin- 
cott Co., 1919. 354 pp. 

Lemos, Pedro J. and Lemos, John T. Art Simplified. Chicago: Prang Com- 
pany. 174 pp. 

Lewis, Charles D. The Waterboys and Their Cousins. Philadelphia: J. B. 
Lippincott Co., 1918. 172 pp. 

McDonald, Etta B. and Dalrymple, Julia. Um6 San in Japan. Boston : Little 
Brown and Co., 1919. 119 pp. 

McLaughlin, Andrew C. and VanTyne, Qaude Halstead. A History of the 
United States. New York: D. Appleton and Co., 1919. 575 pp. 

McPherson, William L. The Strategy of the Great War. New York : G. P. 
Putnam's Sons, 1919. 417 pp. 

Mahoney, John J. Standards in English. Yonkers: World Book Co., 1919. 
198 pp. 

Mirick, George A. Home Life Around the World. Boston: Houghton 
Mifflin Co., 1918c 158 pp. 




SCIENTIFIC SUPERVISION 

Supervision is a term whose meanings range from the general 
oversight which a superintendent gives to the school system as 
a whole to the aid given by one teacher to another. However, 
supervision of instruction is a well defined and important phase 
of educational activity in American schools, and as such is a 
proper field for measurement and research. Moreover, it has 
come about in the chaotic and uncontrolled evolution of our 
school system, that in the past little attention has been directed to 
the nature and laws of supervision so that the opportunities for 
constructive efforts in this field are very great. 

This Journal will welcome accounts of the application of 
scientfic methods to supervisory problems. School men every- 
where are beginning to consider the best ways of organizing 
supervision of instruction is a well-defined and important phase 
They are analyzing the work of supervision and finding that it 
consists of many different types of activity. The inspection and 
rating of teachers is a well-recognized function of supervisory 
work and one which eventuallv entails measurement. Instruc- 
tion and assistance are two other functions in which measure- 
ment may be of very great aid, both in selecting the teachers in 
need of training and in evaluating the effect of the training given. 
Then there are the larger problems of curriculum building, the 
setting of standards, the determination of the efficiency of 
various methods. Finally, there is the problem of determining 
the effect of supervision itself and of the condition under which 
it produces its optimum results. 

Scientific methods are already rapidly transforming supervi- 
sion and will greatly increase its effectiveness. Any school sys- 
tem doing constructive work in this field should feel it a duty to 
publish an account of its experiments for the stimulation and 
guidance of other workers. Contributions of this character are 
solicited. From time to time, also, articles dealing with the 
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general principles and theory of sapenrision will appear in tbese 
pages, and every eflFort will be made to make the Journal of 
senice to those whose interests center in supenrisory activities. 

S.A.C 

EDUCATIONAL TESTS AS IMPORTANT SCHOOLROOM 

EQUIPMENT 

During the decade which is just closing much emi^asis has 
been given to demonstrating to schoolmen that the results of 
teaching can be measured by scientifically devised instruments. 
Within this period a large number of educational tests have been 
de^*ised and sc\'eral of them have been and are now being ex- 
tensively used. It appears that there is no longer any need to 
demonstrate the possibility of measurement It is accepted for 
certain school subjects by even the conservativeSw The need 
today is rather for educating superintendents, principals, and 
teachers in the effective use of educational tests. This need is 
particularly iu"gent in the case of teachers for two reasons. 
First, there are many more teachers than superintendents and 
principals and in general they have not had the same opportimity 
of learning about educational tests. In this ccmnection, it may 
also be mentioned that a very large percent of teachers enter the 
profession each year. Second, the most important reason is 
that educational tests are instruments which teachers may use to 
increase the effectiveness of their instructional efforts. But in 
order that the tests may fulfill this function, it is necessary that 
teachers know how to use them. To give them is merely to take 
the first step. It must be followed by interpretation of the scores 
in terms of pupil needs and modification of instruction in accord- 
ance with these needs. 

This use of educational tests for the improvement of instruc- 
tion is not incompatible with their use for supervisory purposes, 
but the writer believes this supervisory use should not be empha- 
sized more than it is now being emphasized. In fact, there are 
cases on record where this function has been over-emphasized. 
This tends to prejudice teachers against the use of educational 
tests or at least to divert their attention from the instructional 
function. 



Jan. 1920 EDITORIAL 69 

This department of the Journal of Educational Research 
will emphasize the use of educational tests for the improvement of 
instruction. It will welcome communications from teachers who 
have found the test helpful. Those who have secured increased 
results from their teaching owe it to the profession to make 
known their experience. Even if it appears commonplace, it 
may contain just the suggestion which other teachers need. 

The use of educational tests as instruments for the improve- 
ment of instruction places them in the list of important school- 
room equipment. We consider it necessary for a teacher to be 
supplied with blackboards, crayon, maps, reference books, supple- 
mentary readers, and other similar equipment in order that he 
may render efficient service. On exactly the same basis, it is 
necessary that the teacher be supplied with appropriate educa- 
tional tests if his instructional efforts are to be most effective. 
A good teacher will, of course, secure commendable results with- 
out them, but so will a good teacher secure commendable results 
without supplementary readers, reference books, and the like. 
Many boards of education are now purchasing educational tests 
for use throughout their school systems. In fact, it is the excep- 
tion rather than the rule when the teacher is required to pay for 
the tests. But definite provision for the purchase of testing 
materials should be made in the school budget. Until this is done, 
we cannot say that they have official recognition as important 
schoolroom equipment. 

W. S. M. 

ON THE ORGANIZATION OF BUREAUS OF RESEARCH 

The membership roll of the National Association of Directors 
of Educational Research at this writing carries sixty-seven names 
(includes five honorary members) and, geographically, stretches 
from the Atlantic to the Pacific. This Journal as an official 
organ will publish from time to time a full accoimt of the busi- 
ness and activities of the Association as well as special reports 
and news items dealing with the work of particular bureaus in 
various cities. 

It is probable, however, that the Journal might render valuable 
service of a little different t3rpe. Research work in many school 
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&yj>ifinb has not yet groi^ni to a ma^fnitude ii^iidi warrants tht 
L'Miiltli^lmitnt of a sqjaratc department, whOc in many other sys- 
u-iijij iifwly established bureaus are struggling and staggering 
iUnni^li the trying "first years" of independent existence. Prob- 
U'lua and difTiculties without number are sure to arise, and too 
ntivii i\w (xjrson responsible for "putting measaranent across" 
in hii» mIiooI system must meet these difficulties and misunder- 
^^*nllMli^!> alone. Perhaps he is the only person in the school 
^y^lcnl who really understands what educational research means, 
uliM jL-.illy hab a scientific attitude of mind towards educational 
I/imI/Iliiis What such a person needs in the first place is the 
illMi I, |itrbi»nal sympathy and support of others engaged in the 
••HIM UiiiK and strug^'ing with the same diiiiculties. Then, in 
IIm: h«:»MiMl \i\iict, he uccds dircct and immediate help from those 
w-Imi h.ivi? iiMiic* through the fight successfully and who know 
I'Mv^ Ihr ihing j» done. 

1 1 Irt I III- \k'\h\\ itf the associate editor in charge of the work of 
iHiu.nib id iruranh iUixt his department may minister to both 
(In ;.r nrnlh I |i» will enjoy an exchange of personal, confidential 
hmIiii fiMiii rrllnw workers and will strive to bring those whose 
dliriiidlicti (ur hiiiiiLu together. He will do what he can to 
Miif^NMi i|nr.i(iMiih <tiid f»ive advice, or to pass the questions on to 
niH.r NNJiM 1,111 oupplv the answers. Particularly he will wel- 
««'nie hH«Hihiiiiiih mnrerning helpful articles for publication on 
il»<' •H^.iiii^aliiiii aihl (Uiivities of bureaus of research. With a 
li«'ltl Ml I.UKe (o rlioMM* (mm he is keenly conscious of the diffi- 
^^"llies tit niakiuK a i i^ht seleotitm and appeals to all true friends 
of ediuatiniial nieaMuenient to guide him in his editorial duties. 

o* A* Vx* 
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Nattiinal KmntwXuin of Btt^ftorja of 



(R J. AsHBAUGH, Secretary) 



This department will be devoted to the affairs of the National 
Association of Directors of Educational Research. Here news and com- 
ment concerning the members of the Association and their work will 
appear. Official announcements, reports of meetings, statements of 
committees, names of new members, and many less formal matters will 
find an appropriate place. It is planned that the "News Letter," which 
has hitherto been privately circulated among the members of the Associa- 
tion, shall be given wider publicity in these pages. As secretary of the 
Association, Professor E. J. Ashbaugh, Extension Division, University 
of Iowa, Iowa City, Iowa, is a member of the editorial board of the 
Journal and will edit this department. Communications having refer- 
ence to the department should be addressed to him. 

B. Ic. B. 

ANOTHER STEP FORWARD 

This is a time of advancement, of progress, of facing forward. The 
close of the great war which had speeded up production in many lines 
and compelled men to think in new terms, to make new adjustments, and, 
in a sense, move at a more rapid rate, did not result in everything settling 
back into the pre-war condition. While there has been decreased 
activity in some lines, perhaps even stagnation, in the realm of educa-- 
tional thought, the reaction has not set in — at least not yet. 

At the Cincinnati meeting of the Department of Superintendence, 
the National Association of Directors of Educational Research was 
founded. On that occasion eight men met at a luncheon by an almost 
impromptu arrangement. These men were Ayres, Ballou, Buckingham, 
Courtis, Hebden, Melcher, O'Hem, and Shiels. This was in February 
1915, less than five years ago. At the Detroit meeting the following year, 
the first program was put on and the first banquet was held. 

A year later a larger meeting and a larger group at the banquet 
table evidenced the fact that the newly organized association was attract- 
ing the interest of the men who were actively engaged in this field of 
work. Not only so, but the leaders were ambitious and agreed at that 
time to produce a volume for the National Society for the Study of 
Education. One result of that decision was Volume II of the Seven- 
teenth Year Book. How far-reaching that decision has been no one can 
tell. That the Year Book has had a tremenduous influence in directing 
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the thought of superintendents, supervisors and teachers toward educa- 
tional measurement, cannot be doubted. 

At the same meeting it was decided to circulate a bulletin among the 
members as a means of keeping in touch with the activities of each 
other. This bulletin is now rounding up its third year. That it has 
been helpful to the various members was evidenced a year ago when a 
membership fee was first levied in order that the bulletin might be con- 
tinued. 

Another step has now been taken by the Association. By an almost 
unanimous vote the organization decided to adopt the new Journal of 
Educational Research as its official organ. This journal is now mak- 
ing its bow to the public, and the Association is presenting itself to a 
larger field than ever before through this department of the Journal. 
To what extent the Journal will be beneficial to the organization 
remains to be seen. 

It is highly important that with this new venture, each member of 
the Association shall resolve to continue to advance. The high ideals of 
the founders of the Association have been partly realized. The dreams 
of those most deeply interested in it are continually expanding. That 
our work is important, we know; that the results have been, and are, 
valuable in our own local situations, has been demonstrated; that the 
individual members of the Association may make their work beneficial 
to an ever enlarging group, is at least one of the purposes in the 
adoption of the Journal. 

A large number of our members have been made contributing 
editors. The Association, through its secretary, is represented on the 
editorial board. Short news items concerning the things the members 
have in progress, and the problems they have in mind, should be sent to 
the secretary frequently. In fact, the best means by which each indi- 
vidual member may contribute to the success of the Association as a 
whole, is by notifying the secretary the moment a new idea or a new 
plan is conceived. 

ACTIVITIES OF THE MEMBERS 

Practically all directors of city systems report the giving of one or 
more pedagogical tests. An examination of the tests used quite uni- 
formly shows Courtis, Series B, and some form of reading, writing and 
spelling. 

The following members report the use of mental tests during the 
current year : 

Brainerd, Mrs. Margaret, Director of Department of Reference and 
Research, Martin's Ferry, Ohio. 

Dalman, Murray A., Director of Department of Reference and Re- 
search, Board of Education, Indianapolis, Indiana. 
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Dickson, Virgil E., Acting Director of Reference and Research, Public 
Schools, Oakland, California. 

Henry, Mary Bess, Director of Research, Santa Ana, California. 

Lane, Robert E., Division of Educational Research, Los Angeles, Cali- 
fornia. 

Lefler, M. C, Director of Measurements and Research, Lincoln, Ne- 
braska. 

Race, Henrietta V., Director Psychological Clinic, Board of Education, 
Louisville, Kentucky. 

Smith, Leon O., Director Educational Research, Omaha, Nebraska. 

Surveys of local schools, and more or less state- wide testing on 
certain subjects are reported from the following state bureaus : 
University of Iowa, Iowa City, Iowa. 
University of Illinois, Urbana, Illinois. 
State Normal School, Emporia, Kansas. 
University of Nebraska, Lincoln, Neb. 
State Department, Madison, Wis. 
University of Washington, Seattle, Wash. 

Progress in the work of standardization of new tests is reported by : 

Dr. B. R. Buckingham and Dr. Walter S. Monroe, University of Illinois. 
J. C. De Voss, State Normal School, Emporia, Kansas. 
Dr. W. W. Theisen and Cecile White Flemming, State Department, 
Madison, Wisconsin. 

Two members — Leon O. Smith of Omaha and Virgil E. Dickson of 
Oakland — report the interesting experience of each passing through a 
five million dollar school bonding issue. Reports on the result have not 
yet been received. 

Many interesting problems are being attacked by various members. 
Among those listed in recent letters are the following: 

A study of the ability of elementary, high school and college students to 
discriminate between various qualities of poetic expression. 

The educational value of motion pictures. 

The influence of the make-up of a book upon the child's desire to read it. 
Oral presentation vs. written presentation vs. graphic presentation. 
The value of supervision with the use of tests vs. supervision without 

the use of tests. 
The study of a few industries fro the sake of learning the requirements 

of those industries into which the majority of our school children 

go as workers. 
Devising tests of the fundamentals in music as taught in the primary 

grades. 
Does departmental teaching result in better teaching of mathematics? 
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are ^arently of sa- 
by sabject matter 



To what extent do teachers whose class 
perior merit secure better results as 
tests? 



The complete program of the Thursday mectiiig at Qevelaiid will 
be printed in the next issue of the Jouwsal, of Educational Reseasch. 
Plans for the closed meeting on Monday will also be announced. The 
holding of a closed meeting is a departure from previous practice. 
Attendance will be limited to Association members and their invited 
guests. 

The idea of having a headquarters hotel at Qeveland seems to have 
met with general approval. The following members have notified the 
president that they have reserved rooms at the Hotel Stader: 

Samuel B. Allison 
Charles H. Elliott 
W. W. Phelan 
Harriett M. Barthd- 



Murray A. Dalman 
James C. Devoss 
C. E. Chadsey 
Leon O. Smith 
William S. Gray 
W. W. Theisen 
Walter S. Monroe 
F. E. Shapleigh 
E. J. Ashbaugh 
Paul H. Hanus 



C W. Flemming 
Henrietta S. Race 
Carter Alexander 
Clara L. Mallory 
Ira J. Bright 
W. E. Haggerty 
S. A. Courtis 
Chas. Fordyce 
F. J. Kelly 



Arthur W. Kallom 
E. L. Thomdike 
J. W. Richardson 
Charles H. Judd 
H. A. Brown 



Robt. S. Lane 

All new members and such old members as have not reserved rooms 
at the headquarters hotel should do so at once. 

It appears that the addresses presented at our last meeting are not 
to be printed in the Proceedings of the N. El. A. The Proceeding^ are 
being pretty well filled up with addresses and papers from sections of 
the N. E. A. and from affiliated societies whose age is greater than 
ours. It is fortunate, therefore, that we now have a new means of 
publication. The Journal of Educational Research offers its pages 
for the purpose. The secretary g^ves notice at this early date that those 
who are to appear on the program at Qeveland will be requested to fur- 
nish him with a copy of their manuscripts. 





Meetings of the State School Board Association and the City Super- 
intendents' Association of Illinois were held at Urbana, Illinois, on 
October 29 and 31, 1919. 

- . ^ • ^ These two associations have been meeting to- 

. gether now for four or five years. By thus com- 

B d M h bining their annual meetings they have in many ways 

brought about favorable results for the schools. 
Working together the two associations had a large part in securing the 
passage of the Hicks' Law, providing larger revenues for the schools. 
One of the chief objects of these meetings is to create in board members 
a consciousness of the importance of the work they are undertaking. 
Another is to enable the superintendents to conduct their work more 
successfully through the better understanding that these joint meetings 
permit between the professional and lay officers of the schools. 

The two associations met jointly during the afternoon and evening 
of the twenty-ninth and during the morning of the thirtieth. During the 
afternoon of the thirtieth the associations met separately. 

At the first joint session the general subject was Physical Education. 
Assistant Superintendent Ambrose B. Wight of Chicago proposed a 
definite place for physical education in each day's program, specially pre- 
pared supervisors and teachers, adequate equipment, and adaptation of 
the work to pupils of different ages and maturities, regardless of their 
grading in the schools. 

Mr. Charles Krauskopf, principal of the Victor-Lawson School of 
Chicago, described the origin of the physical education movement at 
Chicago, showing its growth from formal gymnastics into directed play. 
He told of the interesting experiment that is being tried in his own school 
in organizing play activities. He stressed the idea that any program 
adopted should be educational in a broad sense — that is, should make 
provision for all the pupils and develop not only physique but also char- 
acter. Mr. Krauskopf believes that this type of physical education 
affords unrivaled opportunities for the development of desirable traits of 
character. 

Superintendent R. O. Stoops of Joliet told about the experiment 
which is being tried out in that city. A co-ordinating board consisting of 
the superintendent of the elementary schools, the principal of the town- 
ship high school, the mayor of the city, and a representative of the 
parochial schools has been formed. By the use of additional money 
voted at a recent election, the Park Board is to furnish a recreational 
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director for the city. The specific activities are to be financed by the 
high school, the elementary schools, the parochial schools, and city 
parks. 

At the evening session on October 29, the subject was "Americaniza- 
tion." Professor Thomas A. Moran of Purdue University gave a fine 
inspirational address on this subject. He urged that the American 
people should actively take up their responsibilities to the immigrant 

Superintendent C. R. Reed of Rockford responded with a short talk 
in which he mentioned somewhat more specifically plans to be taken up 
among foreign people. The discussion was closed by Professor J. W. 
Garner of the University of Illinois, who in a brief but vigorous address 
urged the conservation of all that is good in our institutions, and the 
protection of these institutions from the alien agitator. 

At the close of the evening program. Dr. B. R. Buckingham, 
Director of the Bureau of Educational Research, presented a plan for 
organizing a Superintendents* Conference under the auspices of the Uni- 
versity. The project contemplates the meeting of such a conference 
annually during the same week as that in which the High School Con- 
ference meets. Subsequently at its business meeting the Superintend- 
ents' Association appointed a committee to consider what action the 
Association should take in relation to this proposal. The committee is 
to report at a meeting to be held at Springfield during the week between 
Christmas and New Years. 

The topic of the meeting the following morning was "The Training 
of Teachers before and during Service." Superintendent John W. 
Withers of St. Louis, Missouri, gave the principal address. He warned 
of the danger of deterioration in our schools because of the lack of 
high class recruits for the teaching force. He urged the need of better 
salaries, of greater dignity for the teaching profession, and of more 
effective leadership. 

He saw he necessity of inducing high class young men and women 
to enter our training schools. He summarized plans that had been 
worked out in St. Louis for extension courses for teachers already in 
service. 

Dean C. E. Chadsey, of the College of Education of the University 
of Illinois, discussed the topic, urging the need of higher salaries and 
the value of securing college graduates as elementary teachers. The 
topic was further discussed by Dr. E. H. Taylor of the Charleston State 
Normal School who suggested among other things, the sending out of 
training teachers from the normal schools into the public schools to 
supervise teaching ; by President J. Stanley Brown, of the DeKalb State 
Normal School, who pointed out that the normal schools of the state are 
now handling a))out 60 percent of their possible attendance and urged 
the desirability of getting more young women to enter these schools; and 
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by Superintendent T. E. Savage of Havana, who considered some of the 
plans specifically adapted to the smaller cities. 

During the afternoon of October 30 the School Board Association 
was addressed by Mr. W. G. Spurgin of Urbana on the subject of "Con- 
solidation of School Districts and the Enlargement of the Territorial 
Unit." After the address a business session was held. 

At the same time the City Superintendents' Association, prior to the 
business meeting, listened to an address by Miss Ida^ Hoffman of the 
East St. Louis public schools on "The Teacher's Viewpoint of Construc- 
tive Supervision." She believed that all supervision should be construe- 
tive,. that teachers should always be invited to comment on suggestions 
offered and to offer solutions for problems in supervision, and that super- 
visors should encourage teachers at each step in their work by pointing 
out "high spots." This paper was discussed by Superintendent H. A. 
Perrin of Jacksonville, Illinois, who urged the importance of standards 
of achievement, and by Superintendent W. R. Curtis of Kewanee, 
Illinois, who emphasized the participation of teachers in supervision. 

By having spelling tests given in a number of states, Dr. B. R. 
Buckingham secured data which made it possible to add 505 new words 
to the 1,000 words of the Ayres Spelling Scale. With .the very generous 
A Q ir permission of Dr. Ayres, this list together with the 

^ original 1,000 words is now published under the title 

of Buckinham's Extension of the Ayres Spelling 
Scale. The new words tended to be more difficuH than those of the 
original scale. This was felt to be fortunate because the Ayres Scale 
is less useful for upper grades than for middle and lower grades because 
of the fewness of the words at the high end of the scale. 

It should be understood, however, that the extended scale does not in 
its entirety constitute a fundamental vocabulary scientifically deter- 
mined. The added words were not obtained, as were the original words, 
from tabulations of frequency of use. They were selected from a much 
larger list secured by taking the words common to a number of spelling 
books. Therefore, one should not asstune that the 505 new words arc 
the next most common words after the 1,000 contained in the original 
Ayres Spelling Scale. 

In constructing the Extension, the words of the original scale were 
not disturbed. All of the new words are placed in the appropriate 
columns under the old words and printed in italics. The new words have 
thus been kept separate from the old ones and a person who secures the 
Extension also has the original Ayres Scale intact. 

Buckingham's Extension of the Ayres Spelling Scale is published 
by the Bureau of Educational Research of the University of Illinois. 
Sample copies will be sent postpaid on receipt of 10 cents. In quantity 
the Scale will be furnished for 8 cents per copy. 
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The first program meeting of the Illinois Section of the Mathe- 

Ttf • ^^ matical Association of America was held at the 

lUinois Section 

If th Heal University of Illinois on November 22, 1919. There 

Amand ri were fifty-nine persons present which included some 

visiting high school teachers of mathematics. The 

program was as follows: 

L Address by H. E. Slaught, President of the Mathematical Asso« 

ciation of America. 

2. Round Table Discussion of the Topic : "Freshman Mathematics 

as Related to Varying Admission Credits from the High 
Schools." Discussion led by C. E. Comstock, Bradley Poly- 
technic Institute and M. W. Coultrap, Northwestern College. 

3. Address: "The Training of Mathematics Teachers," by E. B. 

Lytic, University of Illinois. 

Discussed by Malcolm McNeill, Lake Forest College, Bessie I. 
Miller, Rockford College, W. J. Risley, James Millikin Uni- 
versity. 

4. Address: "How Mathematicians Work," by Henry Blumberg, 

University of Illinois. 

President Slaught outlined the history of mathematics teacher 
organizations in the United States and led up to the special need and 
great opportunities for real service facing this new organization. 

The discussion of high school courses and college entrance credits 
was lively and suggestive of needed investigations and standardization. 
There seemed to be a general feeling that skill in formal symbolic manipu- 
lation was being overemphasized to the detriment of mathematical think- 
ing in problem situations. 

Mr. Lytic outlined a course of training desirable for all high school 
teachers of mathematics but remarked that such standards of prepara- 
tion were hardly worth considering until increased salaries were suffi- 
cient to attract our ablest men and women into the teaching profession. 

Mr. Blumberg gave some concrete ways in which some great mathe- 
maticians had worked and made a few generalizations in the way of 
suggestions for more effective methods of work. 

The interest exhibited throughout this meeting promises well for the 
future of this new organization. It is the intention to hold annual meet- 
ings ; and there is no reason why valuable contributions cannot be made 
to investigations in curriculum and teaching problems in both high 
school and college mathematics. 

The former officers were elected for another year. They are: 

Prsident : J. A. Foberg, Craine Junior College. 

Secretary: E. B. Lytic, University of Illinois. 

Realizing in an indefinite way the undoubted value of many reports 
of investigations as these have been embodied in master's and doctor's 
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dissertations, the director of the Bureau of Educational Research of the 
Q^ . University of Illinois, undertook to obtain from the 

Theses L' ted ^^^^s of the departments of education in the various 

colleges and universities of the country a list of the 
authors and titles of such dissertations as have been accepted since Janu- 
ary 1, 1917. The attempt was made more or less as an experiment. 
Unusual interest, however, was manifested by those who sent in material 
and it has been thought wise to assemble it as an informal report. It 
can hardly lay claim to completeness, although all the heads of depart- 
ments addressed responded either by indicating that they had nothing 
to report or by furnishing the desired lists. 

A classification of the dissertations will be made so far as the titles 
make this possible. It is estimated that the material will constitute 
about seventy mimeographed pages. A copy of the report will be sent to 
all those who contributed to it. A limited number of reports will also be 
offered for sale at one dollar each. These dissertations have sometimes 
been printed either completely or in the form of abstracts. These facts 
have been noted in the report as far as known. Even unpublished dis- 
sertations may generally be borrowed for an individual by a library. 

The Extension Division of the University of North Dakota has a 
Bureau of Educational Cooperation which includes the activities of the 
State High School I^eague. At the present time these are debate, decla- 
mation for boys and for girls, music in its various 



M rth n«k tA forms, and athletics. A state contest is held at the 

University in May each year. At the same time the 
county superintendents and high school principals have a three day 
conference. The director of extension work, Albert H. Yoder, attempts 
to answer professional questions arising in connection with school work. 
He has also organized a child welfare department. The medical 
school, state public health laboratories, departments of education and 
psychology, and the university library are cooperating in this work. 
A child welfare clinic was opened December first. Another new feature 
of the division is the University Extension Reading Course intended to 
supply a service to the people of the state desiring such intellectual 
opportunities as can be realized during the long winter evenings. The 
list this year contains about a dozen titles in as many fields, as : 

Thayer, William Roscoe. Theodore Roosevelt; An Intimate Biography, 

Boston: Houghton Mifflin Co., 1919. 
March, Francis Andrew. History of the World War, Philadelphia: 

J. C. Winston Co., 1918. 
Gompers, Samuel. American Labor and the War, New York: Geo. 

H. Doran Co., 1919. 
Ogg, Frederick Austin. National Progress i^oy-iy (American Nation 

p History, V. 27.) New York: Harper and Bros,, 1918. 
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Foster, John Watson. Practice of Diplomacy as Illustrated in Foreign 
Relations of the United States. Boston: Houghton Mifflin Co., 
1906. 

Trowbridge, Edward Dwight. Mexico Today and Tomorrow. New 
York: Macmillan Co., 1919. 

The Executive Committee of the Wisconsin State Teachers' Asso- 
ciation this year consented to add an Educational Measurements Section 
to its already long list of sectional meetings. Dr. W. W. Theisen, State 
^. „ - . - Director of Educational Measurements, arranged 

R h S cti *^^ program. The meeting drew an attendance of 

more than five hundred even though scheduled at 
the same hour as several of the stronger sections. Following the pro- 
gram a number of the leaders met at a luncheon at the Hotel Wisconsin 
for the purpose of effecting a permanent org^ization of educational 
research workers. The new organization will be known as the Wisconsin 
Educational Research Association. Its purpose is not only to foster edu- 
cational research but to keep members in touch with what other members 
are doing in the way of educational investigation and experimentation. 

Officers elected were : Superintendent C. J. Anderson of Stoughton, 
President; Mrs. C. W. Flemming, State Supervisor of Educational 
Measurements, Secretary-Treasurer. Dr. Edgar F. Riley of the Plattc- 
ville Normal was chosen president of sectional meeting for next year. 

At the last session of the Legislature of North Carolina an appro* 
priation was made for conducting a State Survey. Dr. Frank P. 
Bachman, of the General Education Board has been appointed to direct 
N rth ^^^ work. Professor M. E. Haggerty of the University of 

p .. Minnesota will have immediate charge of the tests and 

^ measurements. Examinations will be given in the high 

schools and in the elementary schools of both rural and 
urban districts. The present plan contemplates giving tests in spelling, 
arithmetic, reading, algebra, Latin, and English composition. It is 
proposed also to submit intelligence tests — at least in a limited way. 
Professor Haggerty will go to North Carolina about January first to take 
up his part of the work of the survey. 

An appropriation of fifty thousand dollars in five annual payments 
has been granted to the Iowa Child Welfare Research Station of the 
State University of Iowa, of which Dr. B. T. Baldwin is director, by 
Ch'ld VF If ^^^ National Women's Christian Temperance Union, 

P h St fi ^^^ ^^^ purpose of making detailed scientific investi- 

gation into the development and conservation of 
child life. The gift is for research and the station will be given a wide 
range of freedom in the selection of its problems, which will center 
around the field of eugenics, nutrition, and the mental and social de- 
velopment of the child. 
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IMPROVEMENT IN SCHOOL SUBJECTS THROUGHOUT 

THE SCHOOL YEAR 

V. A. C. Henmon 
University of Wisconsin 

The nature, amount, and rate of improvement in the case of 
relatively simple functions has been studied in some detail. The 
more complex abilities in school subjects have scarcely been 
touched. In discussing improvement in informational, apprecia- 
tive, analytic, and selective functions, Thomdike pertinently 
remarks: "It is a noteworthy commentary on the newness of 
scientific study of education that nobody has yet measured the 
actual progress of any single child in learning any school subject 
for over a month, or in learning any of the informational subjects 
for even a week."^ Standardized tests which might be used for 
such measurement are now available in most of the subjects of 
the elementary school curriculum and in some secondary subjects. 
Ordinarily they have been administered in September and June 
and comparisons have been made with norms at the beginning 
and end of the school year. Numerous questions arise that can 
not be answered by measurements made at such intervals. 
What are the amoimt and rate of progress throughout the year? 
Is the improvement, which is practically always found, uniform, 
or is the improvement rapid in the early part of the year with a 
gradual tapering off toward the close, or is the improvement slow 
at first and more rapid as the year advances? Are there plateaus 
in the progress curve? How do school subjects vary in improva- 
bility, both as to nature, amount, and rate of gain, and as to the 

^ Thomdike, £. L. Educational psychology. New York: Teachers College, 1913, 
Volume 11: "Psychology of leammg," p. 533. 
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factors and conditions which detennine them? How do indivi- 
duals differ in improvement? These and many other questions 
require more frequent and detailed records of progress than have 
hitherto been available. 

The problem of studying improvement in school subjects 
throughout the year by means of standardized tests given at 
monthly intervab was proposed to Mr. L.J. Coubal, Principal of the 
Alice School, Hibbing, Minnesota, in 1915, asa thesis for a bachelor's 
degree. A portion of the material was later used by Mr. Edward 
Van Landegend for a study of individual differences in improve- 
ment. The results of both studies are so striking as to deserve 
wider publicity. 

Tests were given to 32 pupUs of the second grade, 33 of the 
third grade, 25 of the fourth grade, 18 of the fifth grade, and 20 
of the sixth grade. Rate and comprehension in reading were 
measured by Starch's tests in the fourth grade only, as alternative 
tests could not be provided for all the other years. The scores 
for rate are in terms of the number of words read per second and 
for comprehension in terms of the number of words correctly 
reproduced. Rate of writing was determined for ail the grades, 
and the quality was rated by the Ayres scale. Starch's spelling 
tests, consisting of one hundred words, were given to all the 
grades, the scores giving the number of words correcUy spelled 
out of one hundred. Ability in addition, subtraction, multipli- 
cation, and division were measured by the Courtis Standard Re- 
search Tests, Series B, Fonns 1, 2, and 3, in the fourth, fifth, and 
sixth grades. The tests, except in arithmetic, were given by the 
teachers under very specific directions, the principal also being 
present. The tests in arithmetic were all given by the princip^ 
of the school. 

The results of the tests appear in Tables la to le inclusive. 
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Complete results in reading, writing, spelling, and arithmetic 
were available for the fourth grade. In Figures 1-7 solid lines 
show graphically the progress for this grade from September to 
May. The standard September and June scores for these tests 
are shown by dashed lines. In these figures the letters along the 
base line refer to the months from September to May. No 
September scores are available for multiplication and division. 
Hence no dashed lines appear in Figures 6 and 7. June scores 
are indicated by a point at the right of each of these figures. 
Since the curves for the other grades show similar tendencies, the 
records of the fourth grade only will be used for this discus^on. 
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The pmnary purposes of this study vrerc (l) to mUsure a& 
exactly as possible the amount of improv-ement throughout the 
year, and in particular to discover the effects of experimental 
conditions; (1) to End the t>-pical cun-e of pit^ress, if there is 
one, under such conditions; (3) to compare differences in rate of 
progress in different school subjects; and (4) to secure data on the 
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effects of equal practice on individual differences. It was thought 
that the giving of the tests at regular intervals might be a valuable 
incentive and moreover would be of great use to a supervisor in 
diagnosing defects in individuals and detecting inequalities in 
emphasis or other irregularities. 
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The figures and tables bring out certain significant facts: 
1 . The astonishingly great amount of improvement. — ^The effect of 
applying the tests at regular intervals throughout the year is 
nothing short of remarkable. This fourth grade group of 25 
pupils began the year with scores approximating closely the 
standards. At the end of the year the gains exceeded all expecta- 
tions. In rate of reading the initial score of 1 . 5 words per second 
in September is considerably below the standard, while the May 
score of 3 . 1 words attains the standard of the sixth grade. In 
comprehension the initial score of 31 words reproduced is above 
the standard considerably, rate having been sacrificed for com- 
prehension in the first month, while the May score of 40 . 4 words 
is again that of the sixth grade. In spelling the September score 
of 41 . 1 words is very close to the standard, while the May score 
of 56.7 words is almost that of the fifth grade. In writing the 
initial scores approximate closely the standard June scores for the 
grade, while the final score for rate is that of the fifth grade and 
for quality midway between those of the fifth and sixth grades. In 
the four fundamental operations the gains are even more striking. 
The number of rights runs in addition from 2 . 3 to 6 . 5 (standards 
2 . to 3 . 0) , in subtraction from 1 . 4 to 8 . (standards 1 . to 3 . 0) , in 
multiplication from 1.1 to 6.4 (June standard 1 . 5) and in divi- 
sion the final score is 6.2 (standard 1.0). The final scores in 
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arithmetic in attempts and rights are in all cases above the 
standards of the sixth grade and in many cases are above those 
of the seventh grade. When it is borne in mind that selection by 
eliminating the poorer pupils accounts in some measure for the 
increase in the standard scores from year to year, the effect is all 
the more noteworthy. 

It should be noted also that the gain in one subject is not due 
to overemphasis upon it and accounted for in part by loss in other 
subjects. The results of a very large share of the instruction of 
the fourth grade were measured and large gains are shown in every 
case. Nor is the increase due to constant drill. When a test 
was completed it was put aside and not used again till the end of 
the next month. No alteration was made in the work of the 
school except for the monthly tests. The regular work of the 
fourth grade involves a five to ten minute daily exercise in the 
four fundamental operations in arithmetic. 

The results are in accord with those attained in laboratories 
which have always shown very great improvement with practice 
under experimental conditions even in traits which in the ordinary 
drcimistances of life have been much subject to practice. Labora- 
tory experiments in memorizing, for instance, have shown very 
great gains under experimental conditions by those who have 
memorized more or less all their lives and whose capacities might 
be supposed to have been brought near the limits of improvement. 
In sharp contrast is the rate of improvement ordinarily found in 
school children as is indicated by the relatively small gain from 
September to June in the standard scores. 

Certain practical applications of these results suggest them- 
selves. Would it not be desirable to place a great deal of school 
work in the form of a practice experiment in which the pupil 
tested himself at regular intervals by objective methods, kept his 
own score, and watched his gain or loss from week to week or 
month to month? All experiments show that this would be an 
extraordinary stimulus to effort. The individual would be com- 
peting not with others but with his own past performances. 
Why should not a pupil record at intervals how fast he reads, 
how much he comprehends and recalls, how well he writes and 
spells, where he stands in composition, how many words he 
knows in a foreign language, how rapidly and accurately he can 
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read or translate^ how long he must study a lesson assignment, 
etc.? The results of these experiments in one school show that 
the experimental conditions subjected the school to a healthy 
strain and that an amount of improvement resulted greater than 
any that has to my knowledge been reported. 

2. The rate of improvement. — ^An inspection of the figures for 
the fourth grade as well as for the other grades shows that progress 
throughout the year is not one of imiform growth. No single 
curve or generalization describes all of the facts, but a curve with 
a long slow rise during the first half or two-thirds of a year, with 
a rapid rise during the last third, fits the facts tolerably well. 
This curve differs markedly from the typical learning curve which 
shows a rapid rise at first, followed by a period of no gain or of 
slow gain. Comparisons with the typical learning curve, where 
relatively new coordinations are set up, can, of course, not be 
fairly made since these curves of progress in school subjects are 
but segments of larger curves. Whether the typical curve of 
progress in school subjects is the one found so frequently in these 
records, it will require further experiipentation to determine. 
It will also require further experimentation to determine how far 
the long plateau period in the early part of the year is necessary. 
It is quite possible that changes in methods and devices, or 
furnishing other stimulations, might bring about greater improve- 
ment earlier in the year. At any rate the facts stand out pretty 
sharply, challenge one's interest, and invite to further study. 

3. The differences in rate of improvement in the different sub- 
jects. — The least improvement is in spelling ability; the greatest 
in arithmetic, particularly in addition, both in rate and accuracy. 
These results agree with those of Kirby.* Arithmetical opera- 
tions reduce to a definite number of combinations, which recur 
frequently, are easily isolated and made the subject of training; 
the associations required in spelling occur less frequently and 
would show a less rapid improvement. We are just at the 
beginning of the study of such differences as these in school sub- 
jects, the types of learning they represent, and the factors and 
conditions of improvement. The nature and rate of improvement 
in history and geography differ no doubt in important respects 

' Kirby, T. J. Practice in case oj school children. New York: Teachers College, 
1913. 
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from those in reading, writing, spelling, and arithmetic. There 
is great need for study of learning processes in each school subject 
under school conditions, u^g standardized tests as instruments 
of analysis. Such tests have furnished a valuable means of 

TABLE n. INDIVIDDAL DIFFERENCES IN ADDITION, SUBTRACTION, 

AND UTJLTIFLICATION COMBINED. GRADE IV 
ScMcs— Sum of Rights in Courtis Standard Research Tests in Arithmetic Series B 



Pupa 


S 


O 


N 


D 


J 


F 


M 


A 


M 


Gross 
Gain 




13 
1 
13 
11 
S 


15 
6 

16 
8 
6 


13 
9 
15 
10 
12 


18 
18 

25 
19 
16 


17 
22 
21 
18 


23 
14 
20 

IS 


31 
•^1 
51 
23 
25 


35 

41 
34 

29 


"38 
37 
32 
51 
28 








3 








5.. . . 


23 






Av. Group I 


S.6 


10,2 


11.8 


19.2 


19.5 


18.8 


28.2 


34.6 


.13.2 


24.6 




2 
4 
4 

9 

5 


5 
4 
S 

7 

3 


12 
11 
8 

14 
9 


11 

15 
7 
15 
10 


11 

15 
12 
13 
14 


12 
12 
12 
IS 


21 
20 
IS 
20 
18 


20 
28 
26 
23 
21 


28 
24 
23 
22 
20 




7 


20 






9 


13 










Av.Gtoupn 


4.S 


4.8 


10.8 


11.6 


13.0 


13.0 


20.8 


23.6 


23.4 


18.6 


11 . ... 


9 
7 

3 
1 
6 


13 
7 

6 
2 

10 


12 
6 
3 
4 
5 


17 
8 

7 
8 
7 


13 
5 

8 
10 


8 
7 
5 
9 
12 


21 
16 
14 
14 
IE 


22 
16 
19 
21 

6 


18 

17 
17 
17 
16 


9 






13 


14 














Av. Group in 


5.2 


7.4 


6.0 


9.4 


9.0 


8.2 


16,6 


16,8 


17.0 


U.8 







3 
4 



4 
7 
2 
3 


3 
5 

5 

2 


4 
6 
4 
11 



12 
2 
9 

12 

4 


7 
10 
6 
4 



10 

5 

9 



13 
8 
11 

11 


16 

to 

9 

6 








18 


9 






20.. .. 


2 






At. Group IV 


1.4 


3.2 


3.8 


5.0 


7.4 


5.4 


6.0 


10.8 


10.0 


8.6 


Class Averages 


5.0 


6.4 


8.3 


lU 


12.1 


10.9 


18.5 


22.0 


20.9 


15.9 
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diagnosis, but progress in therapeutics has not kept pace with 
progress in diagnosis. 

4. Individuai differences in amount and rale of improvement. — 
To what are the great gains with practice due? Are they due to a 
unifonn gain by all pupils, are diey due to very great gains by 
the better pupils, or are tiiey due to large gains by the poorer 
pupils? Do the initial individual differences tend to increase or 
decrease throughout the year? The few studies that have been 
made have shown marked differences in improvement and, more- 
over, they have shown that individual differences tend to increase 
rather than to decrease with equal amounts of practice.* The 
data in this study point unmistakably to the same conclu^on. A 

TABLE in. INDIVIDUAL DIPTERENCES IN FOUR FUNDAMENTAL 

OPERATIONS. GRADE V 

Scorw— Sum of Rights in Cwirta Standard Reseatch Twtefai Arithmetic, Seriw I 



PupU 


S 





N 


D 


J 


F 


M 


A 


M 


Grass 
Gain 




^9 
28 
S 
18 


12 

25 
20 
20 


21 
31 

20 
31 


36 
39 

17 
34 


36 

40 
19 
30 


47 
44 

28 
39 


64 

50 

47 
47 


65 
63 
69 

43 


64 
63 

63 
56 






















15.g 


18.8 


25.8 


31.5 


31.2 


39.S 


52.0 


60.0 


61.5 










17 
11 
19 

e 


17 
11 
16 
5 


ii 
22 
29 

21 


33 
22 
34 
21 


23 
20 
17 


48 
27 
38 
20 


56 

33 
40 
31 


62 
46 
42 
53 


51 
44 
42 
41 




















Av. Group II 


U.3 


12.3 


26.3 


27.S 


23.3 


33.3 


40.0 


50.8 


44.5 


31.2 




18 

8 
13 

7 


16 
17 
14 

7 


21 
20 
15 
11 


22 
19 


23 
25 

18 


28 
20 
25 
11 


38 
31 
30 
22 


52 
37 

19 


39 
38 
33 
20 






















11.5 


13.5 


16.8 


17.3 


22.0 


21.0 


30.3 


36.0 


32.5 










13.5 


15.0 


22.9 


26.2 


25.8 


31.3 


40.7 


50.1 


46.2 









*17ionidike, E. L., Educational fsyiMogy, Mtftr et 
College, 1914. n>. 390-94. 
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special study was made of individual differences in arithmetic 
in the fourth, fifth, and sixth grades. For this putpose a single 
score for each pupil was secured by adding together the number 
of examples right in each of the four fundamental operations. 
In the fourth grade the score is the sum of the rights in addition, 
subtraction, and multiplication, as the work in ilivision was not 
begun until December. The twenty pupils of the fourth grade 
were divided into quartiles on the basis of the May score. The 
pupils of the fifth and sixth grade into tertiles. 

Tables II-IV give the individual group and class scores for 
each month and the gross gains through the year. 

TABLE IV. INDIVIDDAL DIFrERENCES IN FOUR FUNDAMENTAL 

OPERATIONS. GRADE VI 

Scores—Sum oE Rights in Courtis Standard Research Tests in Arithmetic, Series B 



PupU 


S 
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.\ 


M 


Gross 
G:iin 




28 
.W 
21 
21 
23 


,1S 
30 
20 
19 
21 


4S 
38 
36 
31 
29 


56 
45 
2S 
U 

27 


50 
42 

33 
30 


57 
48 
38 
35 
35 


69 

61 
51 
43 
46 


66 

67 
65 
.W 
S3 


79 
62 
61 
61 
52 




2 




















Aw. Group I 


24.6 


25.6 


36.4 


36.0 


38.8 


42-6 


54-0 


61.4 


63.0 


38.4 


6 


16 

14 
9 


40 
11 

20 
21 
6 


4* 
36 
2& 
23 
16 


32 
34 
30 

21 
12 


36 
33 

28 
27 
21 


34 
36 

30 
37 
19 


50 
48 
41 
43 
27 


58 
48 
45 
i5 
37 


49 

45 
42 
39 
39 


15 


7 . 








9 


25 


10 


30 


Av. Group n 


18.3 


21.2 


30.4 


27.0 


29.0 


29-2 


41-M 


44.6 


42.8 


24.2 


U 


8 

13 

17 


15 
16 
10 
24 
13 


13 
IS 
17. 
30 
20 


12 
IS 
12 
24 
12 


24 

26 

22 


21 

30 
16 

17 


35 
34 

30 
25 
27 


36 

35 
28 
28 
31 


38 
37 
35 
30 
23 


30 










14 


13 










AT.Greupm 


12. J 


19-5 


19.6 


15.6 


24-0 


21.0 


30.2 


31.6 


32.6 


19.2 


□us Avenge 


19.4 


20.8 


28.8 


26.2 


31.0 


31.5 


42.0 


45.9 


46.1 


26-7 



Td.J,N9.i 



The {Hoblem <rf measoiiiig aoanmidr tbc unoimt of improve- 
ment vith prmctice. and e^>eculh' rht cnrnponscm of imfividuals 
vith varying initial and final f&deacy scores in amoant and 
rate of gain, is beset vith difBcolties. as has been frequently 
pointed oaU* While it is thereiore impossible to state adequately 
or definitely the amounts and rates of gain by either a gross gain 
or a percentile method, an inspection of the tables shows that by 
any rational method of inteipretation the sciiptnral law "to him 
that hath shall be gi\-cn'* holds. Those with the hig^t initial 
scores have the highest final scores and gain most both absolutely 
and relatively. This is perhaps best indicated by expressing the 
scores in terms of deviations from the averages. Tables VarVc 
inclusive give these facts for the three grades. 



TABLE Va. GROUP DE\'L\TIOXS FROM CIASS A\"ERAGES. GRADE IV 



S 



O 1 X 



Group I ; -^3.6 -3.8 +3.5 

II -OJ: -1^ +2.5 

III +OJJ +1.01 -1.7 

IV -3.6! -3.2 -4.5 



>f 



tt 



»» 



D 



F t M 



A 



+8.9; -I- 7.4 



+0.3 
-1.9 
-6.3 



+1.1; 



7.9 
2.1 



-3.1} -2.7 
-4.71 -SJi 



+9.7 

+2.3 

-1.9 

-12.5 



+12.6 
+1.6 
-5.2 



M 



+12J 

+23 
-3.9 

-ia9 



TABLE Vb. GROUP DE\TATIONS FROM CLASS A\'ERAGES. 


GRADE V 
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D 


J 


F 


M 


A 


M 


Group I 


+2.3 
-0.2 
-2.0 


+3 8 
-2.7 
-1.5 


+2.9 

+3.4 
-6.1 


+5.3 
+1.3 
-8.9 


+5.4 
-2.5 
-3.8 


+8.2 

+2.0 

- 10.3 


+11.3 

-0.7 

-10.4 


+9.9 

+0.7 
-14.1 


+15.3 


" II 

" III 


-1.7 
-13.7 



TABLE VC. GROUP DEVIATIONS FROM CLASS .AVERAGES. GRADE VI 





S 
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D 


J 


F 


M 


A 


M 


(irtnjt) I 


+5.2 
-l.l 
-7.1 


+4.8 
+0.4 
-1.3 


+7.6 
+1.6 
-9.2 


+9.8 

+0.8 

-10.6 


+7.8 
-C.2 
-7.0 


+11.1 

-2.3 

-10.5 


+ 12.0 

-0.2 

-11.8 


+15.5 

-1.3 

-14.3 


+16.9 


1 

" II 


-3.3 


" III 


-13.5 



* Thomdikc, E. L., Psychology of learning, 1913, pp. 165-77. 
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It is apparent that Group I in each case deviates farther and 
farther above the average with each succeeding month, while 
Group IV in the fourth and Groups III in the fifth and sixth grades 
drop farther and farther below the average. The highest group 
progresses with a marked positive acceleration, while the lowest 
group progresses with equally marked negative acceleration in 
relation to the class average. The result is that while Group IV 
in the fourth grade attains the standard score of the grade, Group 
I with an initial score of the fourth grade in June attains almost 
that of a standard eighth grade. The range of variation in pro- 
gress in the fifth and sixth grades is similarly great — ^far beyond 
the range of standards published. 

This study is but a beginning in an important problem, viz., 
to record more accurately than we have hitherto the progress of 
children through the school year. Progress is determined by a 
great nimiber of factors and conditions, all of which need to be 
carefully studied. The great effect of placing work under experi- 
mental conditions as a stimulus to interest and effort is amply 
demonstrated. Its value for supervisory purposes in diagnosis 
and classification is equally clear. 



IMPROVEMENT OF INSTRUCTION THROUGH THE 

USE OF EDUCATIONAL TESTS 

Walter S. Monroe 
Assistant Diredor Bureau of Educational Research, University of lUinais 

A few years ago in conversation with the superintendent of 
schools in a city of about forty thousand population, I inquired 
concerning the use he was making of educational tests; he replied 
that he was using tests, that in fact, he made it a point to give 
each new test to a few hundred pupils. He then made a very 
significant statement. He said that he had given the Courtis 
arithmetic tests the year before, and that his teachers had failed 
to find the pupils doing any better in arithmetic after the tests 
were given than they did before. 

Unfortunately, this incident represents the attitude of a 
considerable number of users of standardized tests. They con- 
sider such tests as teaching devices, and express dissatisfaction 
with them when they do not cause pupils to do better school 
work. Others have thought of educational tests as playthings 
which they might use for their own entertainment or for the 
entertainment of audiences at teachers' meetings. Beautiful 
charts in colored inks have been constructed to represent the 
scores obtained; and because such charts are new and tangible, 
they have attracted much attention. 

Educational tests are not playthings; neither are they teach- 
ing devices. It is not their fimction to increase the abilities of 
pupils. They are designed to yield information in the form of 
measures of the abilities of pupils. Only as this information is 
interpreted in terms of pupil needs and these are in turn used as 
a basis in planning future instruction, will the use of tests increase 
abilities. 

In the past the major use of educational tests has been by 
superintendents and principals. Their purpose has been to 
ascertain how Jthe pupils of their schools stood in comparison with 
pupils in corresponding grades of other schools or with reference 
to standard scores. In some cases the tests have been used as a 

96 
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basis for judging tie effidency of teachers. These uses are 
important and in the last analysis have as their function the 
improvement of instruction. Educational tests, however, may 
be used and indeed ought to be used directly by teachers as 
instniments for making more effective their efforts as instructors. 
We now have sufficient scientific evidence to show that the 
measurement of the abilities of pupils at appropriate intervals v 
and the use of this information in planning future teaching will i 
increase the abilities of the pupils. Hence, it is important that 
teachers learn how to use standardized tests to improve instruc- 
tion. "« 

Giving these tests, marking the papers, and tabulating the 
scores are only first steps. In many instances beneficial results 
have followed when the work has not been carried beyond this 
stage. The attention of both pupils and teachers may thus have 
been directed to the minimum essentials of the school subject. 
They may have been given a more definite aim and a stronger 
motive. But, in order to reap the full benefit, the scores obtained I 
from giving a test must be interpreted in terms of pupil needs;* 
and then the instruction must be modified in accordance with the | 
interpretation. This article is, therefore, written to suggest a 
method of interpreting the scores of a group of pupils. 

Interpretation in terms of pupil needs involves more than \ 
simply ascertaining that the class median is above, up to, or ■ 
below standard or that certain pupils are above, up to, or below 
standard. Doing this is equivalent to a physician's telling his 
patient that his temperature is 103, that his liver is not func- 
tioning properly, that he has serious indigestion, and that he is 
threatened with a nervous breakdown. Clearly this is insuf- 
ficient. If the physician is to be of service to his patient, he 
must interpret these facts in terms of his patient's needs. Then 
in accordance with these needs, the physician must prescribe for 
him — for example, tell him to eat no meat or starchy foods, to 
spend several hours out of doors each day, and to take certain 
medicines before each meal and at bedtime. 

In interpreting scores of educational tests in terms of pupil . 
needs, it is necessary to make similar prescriptions of changes in * 
instruction. The scores of the pupils and of the class, together ^■ 
with the errors, correspond to the temperature, pulse rate, con- 
dition of tongue, location of pain, etc., of a patient. They are 
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the symptoms; and it is their meanings which are of real impor- 
tance. Besides saying that the median of a certain sixth grade 
dass in silent reading is below the standard for the fifth grade 
and that 25 percent of the pupils are below standard for the 
fourth grade, while only 18 percent are up to or above standard, 

I7e should add that as a whole the class needs to give less attention 
o oral reading, that it needs to devote a practice period of 30 
minutes a day to the silent reading of simple descriptive prose, 
and that certain specified pupils need to give special attention 
to acquiring the meaning of words. An interpretation may also 
include a statement that certain pupils who made very high 
scores ought to be promoted to the next grade, or that they 
need not continue to study silent reading, but that they should 
spend the time thus saved in the study of arithmetic. 

Different classes as a whole have different needs, and the 
individual members of a dass have a great variety of pupil needs. 
The first step, however, in interpreting the scores of a class is 
to ascertain the needs that are common to the dass as a whole 
or to large groups within the dass. This should be followed by 
an individual interpretation of the scores of those pupils at the 
extremes of the group, particularly of those conspicuously below 
standard. At present, we do not have suffident sdentific infor- 
mation to permit us to formulate complete statements of the 
pupil needs which are indicated by the various combinations of 
symptoms. In the absence of such formulations, it will be 
helpful to outline a general procedure which may be followed in 
interpreting the scores of a class after they have been tabulated 
on the dass record sheet. In order that the subject may be as 
concrete as possible, it will be stated in terms of the Courtis 
Standard Research Tests, Series B. However, one can easily 
adapt the general plan to any other test. 

In a rough way we may group the great variety of combina- 
tions of scores of classes under six cases as follows: 

Case 1. Class medians below standard in both rate and 
accuracy. 

Case 2. Class medians for rate below standard with satis- 
factory or high accuracy medians. 

Case 3. Class medians for accuracy below standard with 
satisfactory or high rate medians. 

Case 4. Scores of members of the dass widely scattered. 
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Case 5. Irregular development; class medians in one test up 
to or above standard with class medians in another test 
distinctly below standard. 

Case 6. Class medians for both rate and accuracy up to or 
above standard with the individual scores grouped closely 
about the medians. 

Any particular class may exhibit certain combinations of 
these conditions. For example, the median rate in a test (i.e., 
addition) may be below standard with a satisfactory or high 
accuracy median and at the same time the scores of the members 
of the class may be widely scattered. Such a class would be 
considered as coming under both Case 2 and Case 4. 

For each of these cases, it is possible to list certain probable 
needs. All of these needs may not apply to a given class but 
some of them will almost certainly be appropriate. In general, it 
will be profitable to investigate these needs first and determine 
which of them apply to the class in question. The most probable 
needs for each case are given below. 

Case 1. — This is probably a case of inefficient teaching. It is 
true, there may be some other explanation of the low median 
scores and it is well of course to investigate this possibility. For 
example, it may be suspected that pupils are below normal in 
general ability, and evidence on this question may be obtained 
by giving a test of general intelligence. Or, scores may be below 
standard because of an unusual course of study, and a comparison 
of the particular course with a number of successful courses may 
be made. Still other causes may be responsible to a greater or less 
extent for the condition; but inefficient teaching is the most 
probable single cause. 

Instruction may be inefficient with respect to drill. Perhaps 
more time should be devoted to it, but it is more likely that the 
time already devoted to it should be used more effectively. Drill 
work ought to be organized so that every minute is used by every 
pupil. Many teachers waste time by allowing some pupils to be 
idle while others are occupied. When pupils are working examples 
at the board, some teaches dictate one example at a time and 
do not stop the work until the slowest pupil has finished. The 
result is that pupils who work rapidly are idle a large part of 
the time. It is easy to carry on drill work in such a way that loss 
of this kind will not occur. In the case just mentioned the 
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xmount of ame wasted wiH be zready reduced if several examples 
instead of one are dxctared j.c a dme and the work stopped as 
<ooa as the nxost rapid wuckers mive inxshed. Some teachers 
also waste ome in having purely mechanical work explained when 
the pupils oeed drill raiher than explanation. Agam. drill may 
be inemciettt because of the iiilure y^i the teacher to recognize 
ryS6e of wvrk as important. The need may be increased motiva- 
tion. I: :his is the case, the teacher will dnd educational tests 
:heniseh-es helpcui. la acditiea he can make use of a variety 
ot devices tor <ecurjxg a stronger moci^-e, including the assign- 
raca: ot work u:K:er ::"Tiei conditions. 

i."jcw •*. The ntost probable need of a class which is below 
' standard in race ^i:h >si:ts:actor>- accuracy b for speed drills. In 
other wonK ic is iiieiy that the teacher has not been placing 
sutRcieat cm^^hA^is u^va the rate of work. A possible need is 
for the eliniinativm of time-consuming methods of work, such as 
the use of an elaborate pliraseologj" in performing the operations. 
Fv>r exanxple. pujnls may be required to name each successive 
vligit in adding a cv^Iunin of dgures instead of naming only the 
partial sums. In some cases slow work is due to the failure of 
pupils to cv»ncentrate attention upon the task. Under such 
circumstances they should be trained in giving continuous and 
undi\nvlevl attention to the task assigned. Tins includes, among 
other thing!^« the need for securing a stronger motive. 

Case J. — A low mevlian score in accuracv mav be due to the 
fact that, in working umler the timed conditions of the test, the 
pupils become excited and that in attempting to do a large 
I number of examples they iHxvme careless. \Mien this happens, 
the test should be reiH^ateii: and it is likely that on the second 
trial, the median for accuracy will be much higher. If, however, 
the condition persists, the pupils should ha\'e frequent timed 
drills under the conditions of the test and should thus learn to 
assume the proper attitude toward the test. It may be that the 
need is even more fundamental. There are many different types 
of examples in a given operation — e.g., in addition. Pupils may 
have learned to do some types without having learned to do 
others. For example, they may be able to add short colimms 
without being able to add long columns because of the increased 
. span of attention required. iJ;It may be that the pupils have never 
given instruction upon the particular type of example 
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occurring in the test. If so, they need to be"t4Ught how to do 
this type. - /'- '-^^ 

Case 4, — When the'scores of the several members' of .the class 
are too widely scattered, the probable need is f or -Tuaiyidual/ 
instruction. The form of this instruction will depend dpen the 
particular needs of the individual pupils. An analysis of-th^ 
performance of a pupil is required in order to know his particaldj;''- 
needs; but in general, the probable needs of individual pupils are- . / 
the same as the probable needs of a class. The conditions occur- ' 
ring in Case 4 may often be met by promoting certain pupils to 
a higher grade and demoting others to a lower grade, provided 
the general organization of the school will permit such action. 
When this cannot be done, the teacher must devise some way to 
give to each pupil that instruction which will meet his needs. 
Practice exercises such as the Courtis Standard Practice Tests^ 
have been designed to assist in meeting individual needs. 

Case 5. — Irregular development is made possible by the fact 
that there are a number of different types of examples. Pupils 
may and do learn to do certain types without learning to do 
other types with anything like the same rate and accuracy. 
When irregular development is found to exist, the need is for al 
redistribtution of emphasis in the instruction. Clearly, types fort 
which the scores are low need to be given more emphasis while 
those for which the scores are up to oi: above standard need less 
attention. The Courtis Standard Research Tests, Series B, can 
only show irregularities between the four fundamental operations. 
A series of diagnostic tests will reveal irregularities between 
different types of examples within the same operation. 

Case 6, — When a class is above standard in all respects it may 
be thought that conditions are satisfactory and that the pupils 
have no needs. This, however, may not be true. Among the *' 
most probable needs are (1) promotion to the next grade, (2) less 
time to this subject and more to others, (3) opportunity to take ; 
up more advanced topics. The meeting of these needs (especially i 

* The Courtis Standard Practice Tests in Arithmetic (published by the World 
Book Company, Yonkers-on-Hudson, New York) are practice tests in the four 
fundamental operations with whole numbers. The complete set consists of cabinet 1 
(a set of 720 lesson cards for a class of fifty pupils), cabinet 2 (a set of 288 
lesson cards for a cUiss of twenty), a student's record and practice pad, a teacher's 
manual, and a teacher's record. A specimen set may be obtained from the pub- 
lishers for a dollar. 
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the one iiivoj3vhtgr*^roinotion to the next grade) depends on the 
general plaB!^o*^-organization of the school. When a class is just 
up to stdtMaVd, pupils may need a continuation of the present 
{natruf:tipli'or they may now be ready to go on to something else, 
'•^ochting a class under one of these cases and ascertaining 
.nrjiich of the suggested probable needs apply are the first steps 

*• ^^'interpretation. With the partial exception of Case 4 (irregular 
* distribution of scores) , it is mass interpretation and for that 
reason it is necessarily crude. Like mass instruction, it will not 
fit all pupils. While the members of the class probably have 
Home common needs, there are also likely to be many individual 
needs. Thus such mass interpretation should be supplemented 
by an interpretation of the scores of individual pupils, especially 
of those having the highest and lowest scores. 

/ In both class interpretation and individual interpretation, it 
irt necessary to remember that the teacher has' Jtcci^ss not only 
to the scores but also to the test papers which give the perform- 
ances of the pupilft iu. detail. An analysis of these is helpful, 
especially where there is any uncertainty about the needs of the 
pupils. A score reveals nothing as to what was lacking in the 
mental processes of the pupil, but a^n analysis of his errors may 
reveal the defect and suggest corrective instruction. In making 
this analysis, it will be helpful to classify the_ errors which the 
pupil has made. In multiplicationT^TEe error may be one of 
multiplication, of placing the partial products, or of addition. 
In addition, and to a less extent in the other operations, it is 
frequently impossible to determine the nature of the error. In 
such cases, one should observe the pupil as he works or even 
have him "express orally his mental processes." Whenever such 
detailed studies of the performances of pupils have been made, 
significant facts have been revealed. This kind of study requires 
much time, but the time is profitably employed. 

Although interpretation cannot be reduced to a mechanical 
basis, it is believed that the general procedure just outlined will 
be helpful as a beginning and will lead naturally to the individual 
analyses without which accurate individual adjustments cannot 
be made. The fimdamental thing for the teacher to bear in 
mind is the principle that only when we interpret the scores of 
a test in terms of pupil needs and modify instruction to meet 
those needs will educational tests fulfill their function. 




VALUE OF INFORMAL TESTS OF READING 

ACCOMPLISHMENT 

William S. Gray 
School of Education^ University of Chicago 

Informal tests, as the term is used in this discussion, relate to 
tests which are organized by the classroom teacher or supervisor 
for the purpose of securing accurate records concerning the accom- 
plishments of pupils. They differ from standardized tests in that 
they are not so carefully organized, they have not been given to a 
large number of pupils under similar conditions, and there are no 
standards which can be used as a basis for comparison. It is 
evident at once that such tests have serious limitations as con- 
trasted with the more elaborate types of standardized tests. In 
recommending their use in this discussion it is not intended to 
urge that they take the place of standardized tests. It is in- 
tended on the other hand to show that informal tests must be 
used frequently along with standardized tests, if testing is to be 
continuous and most effective. 

Directions for an informal test of oral reading follow in order 
to illustrate the character of such tests: 

^^Measuring the rate of oral reading, — The simplest measure- 
ment imder the ordinary conditions of class work is probably a 
measurement of the rate of oral reading. This record can be 
secured in any ordinary reading exercise as follows: Choose for 
this exercise one or more selections which the pupils read early in 
the year. Set aside a reading period for a great deal of oral read- 
ing. Make no previous assignment. The pupils should read as 
in ordinary reading lessons without suspecting that their speed 
of reading is being recorded. Have at hand a sufficient quantity 
of reading material so that no two pupils read the same 
paragraphs. 

"The teacher will need a reader which can be marked freely 
with a pencil; also a watch with a second hand. When a pupil 
begins reading, note the exact second at which he reads the first 
word of the selection. Follow the watch carefully, and when 
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exactly sixty seconds have passed, check the word which the 
pupil was reading when the minute was up. Let the pupil con- 
tinue reading wthout interruption to the end of the paragraph 
HH he wouUl in any reading exercise. Make whatever comments 
or a*k whatcNxr questions would be asked in an ordinary reading 
lesion and then go on to the next pupil. If, during the reading, 
a pupil hesitates a few seconds because of a difficult word, pro- 
uouuiT the wor\l for him so that he may continue reading. 

''Ue s^urf that >\>u mark the following points for each member 
oC thr cU?k^: V<^^ ^^^ ivirticular part read by each pupil; (b) the 
(H^ut At which he bc^^an reading; (c) the point which had been 
t>H^\ he\l at the end of sixty seconds. At your earliest convenience 
VA^iwt the nuntl>er of words read by each pupil during the minute. 
iVuut *'a'* and *'the" and other short words, each as one word. 
Ko\Aml the total number opposite the pupil's name on a record 
iihiH^t which >^>u will keep for your own use. Do not destroy 
I hew m\ml*» Keep them on file. They will be valuable for 
p\mu^w oC future comparison. 

** Ihi* tyjM? of exercise should be continued for two or three 
claw periiHls, Usually a teacher who tries to give tests and 
reconl facts for the first time finds that she is distracted and 
inaccurate. Confidence and skill develop very rapidly, however, 
wllh practice. Continue the measurements of the rate of oral 
reading until you feel confident that you can secure the records 
accurately." 

There are three lines of argimient which can be advanced in 
favor of informal tests. In the first place, the number of standard- 
ised tests in reading is limited. At most there are not more than 
ten which have been carefully standardized. Although these 
teats measure the accomplishments of pupils in several phases of 
reading ability they do not include, by any means, all of the 
Hignificant phases. Until a more inclusive set of reading tests has 
been developed, teachers and supervisors will have to organize 
informal tests for their own use, if detailed studies of all phases of 
reading are made. Furthermore, only a limited number of tests 
appear in duplicate or triplicate form. Hence only a few stand- 
ardized tests which are comparable in difficulty can be given at 
difTerent times during the year. It is e\adent, therefore, that if 
teachers and supervisors carry on investigations of reading con- 
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tinuously, informal tests must be used at frequent intervals to 
supplement the more detailed studies made through the use of 
standardized tests. Unless investigations proceed regularly and 
systematically throughout the year, it is probable that tests will 
be interpreted as a novelty. Under these conditions they 
fail to enlist the constructive effort of teachers for any significant 
period of time. 

In the second place, the wide use of informal tests brings to 
the teacher's attention accurate data on which to base judgments 
concerning the needs of pupils. Teachers have been justly 
criticized in the past because they have proceeded with their work 
too largely on the basis of opinion. Standardized tests have 
changed the situation somewhat because their use involves 
detailed analysis, accurate measuring, careful recording, and 
judgments on the basis of facts. In order to provide teachers 
with the necessary means of securing accurate data whenever 
problems arise, it is necessary that informal tests be employed 
more largely than in the past as a part of the regular routine of 
instruction. The most significant value which comes from the 
continuous use of standardized and informal tests is the new 
interest in teaching which is stimulated, and the spirit of investiga- 
tion which is developed. The teacher who scrutinizes her work 
carefully and records accurately, becomes more openminded, 
more interested in adequate proofs, and less willing to follow the 
line of least resistance by accepting blindly all things on authority. 
These results cannot be secured through the occasional use of 
standardized tests. They develop gradually as one makes con- 
tinuous use of recording devices in careful studies of classroom 
problems. 

In the third place, informal tests are given most frequently 
under normal classroom conditions. This is distinctly to their 
advantage because measurements are of most significance when 
they are secured in a normal recitation. It is frequently assumed 
that when recording devices are used regular instruction stops. 
This view has its origin in the fact that standardized tests are fre- 
quently given under somewhat unusual conditions. The fact is 
emphasized at this point, however, that a recording device is 
good only to the extent that it fits into the regular work of the 
class and at the same time gives a series of accurate results. 
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Measurements are of greatest value when they bring out the nor- 
mal facts which are always present but which are not recorded 
for the most part in reading exercises. When asked to secure 
records, teachers should be sure first of all that the process of 
measuring does not change materially the character of regular 
classroom instruction. A normal lesson should be planned out 
in which the pupils get as much instruction as though no recording 
of facts was going on. It is because informal tests fit into such 
a program of measurement and instruction that their wide use is 
most heartily urged at this point. 

Supervisors who plan to pursue investigations of reading in 
which informal or standardized tests are used should not overlook 
the fact that teachers need training in securing records. This 
is a new type of classroom technic in which teachers should be 
instructed just the same as when a new system of handwriting is 
introduced. Many supervisors create opposition to tests by 
imposing nimierous requirements on teachers before they are 
adequately trained to secure records or to imderstand their 
significance. The approach to the measurement idea which 
was made by Superintendent T. W. Callahan of Galesburg, 
Illinois, is significant in this connection. He first organized 
instructions for simple informal tests of the rate of oral reading. 
According to his plan, the teachers were to secure records once 
each month during the year 1918-1919. The following form 
was used as a record blacJc on which to show the results of the 
tests. By using both sides of the card, spaces were provided 
for each month of the school year. The reverse of the card is 
exactly like the face except that the months are different. 
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Each pupil was designated by a letter of the alphabet. Entries 
were made on the card according to the following directions. 
The directions assume that the card is before the teacher turned 
at an angle of 90 degrees to the right from its present position. 

"In scoring on the card, number the spaces from left to right 
to indicate the number of lines read per minute. Then for. 
example, suppose, pupil C reads 9 lines and makes 4 mistakes. 
In the space nimibered 9 place the letter C with a small figure 4 
at the lower right-hand comer of the letter." 

As the tests continued throughout the year, the teachers 
became more and more familiar with the methods of recording. 
The significance of the measurements was emphasized with each 
successive test. When the tabulations for the year were com- 
plete, the teachers were able to see what progress had been made 
by the class as a whole and by individual pupils. The require- 
ments were simple and easily fulfilled. One of the most frequent 
and significant outcomes of a series of informal tests of this type 
is that teachers develop an interest in objective records of the 
results of reading instruction. It is ilnnecessary to add that this 
is one of the important results which an expert supervisor will 
seek to secure. It paves the way for more intensive and intelli- 
gent studies of reading, and for keener interest in the continuous 
use of recording devices. 

Karl D. Waldo, while superintendent of the Sycamore Public 
Schools, organized and conducted classroom tests of reading 
which illustrate in detail the type of work which should be carried 
on regularly in each classroom. In stating the reasons for his 
investigation Mr. Waldo said: "As supervisor I naturally watched 
the reading as it developed through the phonic method and com- 
pared it with the work done under the word plan and also with 
the reading of the higher grades which had started their reading 
with no regular system. With notebook in hand, I endeavored 
to keep a record of the individual work of the three systems for 
the purpose of comparison. These records were not very satis- 
factory and were based on oral reading only, with no attempt to 
determine the comprehension by the children of the passages 
read, other than that which could be shown by the oral expres- 
sion."i 

' Waldo, Karl D. "Tests in reading in Sycamore schools," Elementary School 
Journal^ 15 : 251-2, January, 1915. 
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"When I saw how inadequate the comparison made in this 
way proved to be, I looked for some better method of making a 
record of the work. The attempts of A>Tes. Courtis, Thomdike, 
and others to formulate standard tests suggested the formation 
of a plan for more scientific testing of the reading work. I also 
wished to test the silent rather than the oral reading, for the 
former is of much greater importance, not only later in school, 
but in future life." 

Informal tests were accordingly organized by Superintendent 
Waldo which were simple, which closely resembled the regular 
work of the school, and which could be given in about an hour. 
The material selected for the test was in the first issue of Curreni 
Events, a school paper, for the year 1913-1914. The papers were 
passed out and the pupils were asked to proceed, when the signal 
to begin was given, as they would in reading any newspaper article 
in which they might be interested. Five minutes were allowed 
for the reading. When the signal to stop was given each pupil 
checked the last word read and wrote his name on the paper. The 
pupils were then asked to write a complete account of what they 
had read and to answer ten questions, covering the subject- 
matter read. The accomplishment of each pupil was then ex- 
pressed in terms of his rate of reading, the percentage of the words 
reproduced, and a percentage grade for questions answered 
correctly. 

The same procedure was used in all grades except that the 
third and fourth grades had different material and read a story 
of Daniel Boone in Eggleston's Stories of Great Americans for 
Little Americans, The first test was given early in the school 
year. After six months a second test was given in the same 
manner and with selections of corresponding difficulty. Check 
tests were given to determine the relative difficulty of the passage. 
The results, when tabulated, revealed three important facts* 
concerning the reading in Sycamore. 

1. "Great variation exists in reading ability between dif- 
ferent individuals in the same grade, and many children in lower 
grades are much better readers than the average of the upper 
grades 

« Ibid., p. 267. 
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2. "In careful reading the rate increases but slowly in school 
work after the fifth grade. The increase in comprehension, 
however, is regular from the lower to the upper grades. 

3. "The third and fourth grades are places with the possibili- 
ties for wonderful development, especially in the mechanics of 
reading. The effects of starting the reading with a phonic system 
like the Ward are not evident in the reading of the upper grades. 
Tests tend to stimulate the work in reading, but have more effect 
upon the reading rate than upon the ability to comprehend what 
is read." 

The value of such tests as an aid in supervision was summarized 
by Waldo as follows:* 

These statements show that as a means of supervision and administra- 
tion, tests Uke this one are of much utility. Some teachers may doubt the 
value of the superintendent's criticism or may feel that his opinion of the 
work in their rooms is unwarranted. After such a test there is no need for 
the superintendent to criticize. The facts found in this test were shown in 
the bimonthly teachers' meeting and, after discussion, were accepted by the 
teachers as indicative of the true situation in the reading work. Knowing 
the situation is the first step in the direction of effective work, and after that 
is taken both teachers and superintendent can, in cordial co-operation, set 
about improving the reading work. 

The use of informal tests is not limited to elementary school 
classes. With increasing frequency reports are published dealing 
with the use of such tests in high school classes. Miss Bertha M. 
Smith recently reported* the results of an investigation which she 
made in freshman classes of the high school on efficiency in 
assimilating reading. The passages chosen for the test related to 
Dickens and were taken from Long's English Literature, After 
the pupils had read intensively for five minutes they were asked 
to reproduce what they had read. The comprehension scores 
were determined in terms of the percentage of the total number 
of ideas which were reproduced. These records enabled Miss 
Smith to study the number and types of errors made by different 
pupils. The tests showed that those who do well in their regular 
school work do well in reading tests, and that those who do poorly in 
their daily work do poorly in the tests. The tabulated records 

» Ihid., p. 253. 

^ Smith, Bertha M. "Efficiency in assimilating reading,'* School Review , 
25 : 637-45, November, 1917. 
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revealed the fact that both good and poor readeis are ordinarily 
classified together and are assigned the same amount of work. 
In commenting on the injustice of this situation, Miss Smith 
said : "The teacher taking too much for granted has, no doubt, 
caused many a pupil to go beyond his depth. If tests were to be 
derived which would show what kind of mind the pupil has and, 
in some measure, its capabilities; then if courses were arranged 
in the curriculum that would take care of these variable types 
and would begin with them where their abilities begin, not so 
many pupils would complain, *I'm not interested.' At present 
the good, the poor, the indifferent are grouped in the same class- 
room. Much of the instruction is below what the strong pupil 
needs, and much of it is above the weak pupil." 

To remove similar diflBculty the English department of the High 
School of the University of Chicago classifies its pupils into good, 
medium, and poor readers at the beginning of each year, by means 
of informal tests. Each group is then given assignments which 
are adapted to their capacities. Furthermore, the poorer sections 
are given training in the art of effective silent reading and study. 
From week to week, informal tests are given along those lines 
which have been selected for special attention. 

Four illustrations have been given of the value of informal 
tests in impro\ing instruction. Work of this t>T)e is ahready 
under way in many progressive schools. Many teachers and 
supervisors, however, have been somewhat slow in adopting 
both standardized and informal tests as essential devices for 
securing better results. Evidence goes to show that frequent 
informal tests are just as essential as books, blackboards, supple- 
mentary reading material, etc. They supply the teacher with the 
facts which are necessary in a scientific organization of her work 
from day to day. 

In most cases a supervisory oflBicer must serve as a progressive 
leader in stimulating this tx-pe of work. Illustrations of such 
studies must be presented to teachers. The value of these inves- 
tigations must be emphasized. Directions for carrjing on such 
work must be definitely outlined. Progressive teachers. who are 
interested and who have ability to organize the work effectively 
must be selected for the first studies. The results of their studies 
should be presented to the teachers in order that they may see 
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more clearly the values to be derived from such studies and the 
methods to be employed. The supervisor must hold himself 
responsible for assembling scientific reports relating to the prob- 
lems imder consideration, and for their presentation and inter- 
pretation to the teaching staff. No opportunity should be lost 
to stimulate interest on the part of teachers in making detailed 
studies of their problems. It is because informal tests are proving 
of so much value in this connection that their use has been so 
heartily recommended in this article. 



THE DEVELOPMENT OF THE UNIT PLAN OF 
PENMANSHIP PRACTICE 

H. C. Walker 
Supervisor of Wriiingj St. Louis Public Schools 

The waste of time and energy in teaching muscular move- 
ment writing is probably greater than the waste in teaching any 
other subject of the public school curriculum. 

This is due to several causes, among which is the custom of 
teaching penmanship according to grades rather than according 
to the needs of the children. In arithmetic for example, the 
lower grades represent elementary, the middle grades inter- 
mediate, and the upper grades advanced, instruction. When 
applied to muscular movement writing, however, the grade in 
which the child is working is often immaterial. It may impose 
upon him subject matter which is too difficult for him to practice 
with correct habits; and, as a result of this, his progress in writ- 
ing may be retarded rather than accelerated by his practice. 

The pupil who does not know how to sit, how to hold his pen 
and how to use the correct movement, is a beginner in muscular 
movement writing, regardless of the grade in which he is work- 
ing; and the only way for him to advance is to practice the ele- 
mentary principles until his incorrect habits have given place to 
correct habits. 

Too often the retardation of a child in writing is attributed 
to lack of interest, to absence of natural talent, or to causes other 
than the real one. Frequentiy the cause of failure is not in the 
child himself, but in the course of instruction which does not 
provide him with the kind of subject matter adapted to his 
particular stage^of'progress. 

A few years after the introduction of the muscular movement 
into the St. Louis Public Schools, we discovered that the per- 
centage of good writers among our eighth grade pupils was below 
what we desired, and that considering the time spent in practice, 
the results were not as good as we had reason to expect. 

When muscular movement was adopted, the pupils of all 
grades were on the same plane as far as skill in this method of 
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writing was concerned: but with the continued use of the plan 
some of the children showed more interest in the writing than 
others, some showed greater skill, and to others the subject 
matter of the lessons was better adapted. Added to this was the 
steady influx into all grades of outside pupils, some of whom 
had not had the same training as our own pupils. The result was 
that, at the end of three or four years, there were in every room 
above the third grade three distinct groups of writers — the 
good, the mediocre, and the poor. 

The first group was composed of pupils who wrote well in 
both writing practice and in daily work; the second group wrote 
ovals and easy capitals, but could not apply correct habits to 
the writing of difficult subject matter, or to daily writing; and 
the third could not even make ovals with correct position and 
movement. 

We found that the needs of these three types of pupils, grouped 
together as a class, were as varied as would be the needs o( a 
class of pupils in arithmetic, some of whom had advanced as 
far as subtraction, others as far as fractions, and still others as 
far as percentage. 

I frequently invited the principal of the school to witness with 
me this adverse condition under which the teachers and pupils 
were working. 

We found that where the teacher was adapting her instruction 
to the needs of the elementary pupils of her class, the intermediate 
and advanced pupils were wasting their time by needless review ; 
that where she was working with the mediocre writers, the 
subject matter was too easy for the advanced writers and too 
difficult for the elementary writers; and that where she pre- 
sented subject matter adapted to the needs of the advanced 
pupils, the mediocre pupils and the elementary pupils not only 
failed to derive benefit from the practice, but were actually 
accentuating their errors and establishing bad, rather than good 
habits. 

Our first step toward correcting this unfavorable and dis- 
couraging condition was to organize in accordance with their 
needs in penmanship, three groups of writers in every room, 
known as the A, the B, and the C pupils. The pupils changed 
their seats for writing practice and each group received instruc- 
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tion on separate days while the other two groups studied other 
subjects. While this was in some respects an improvement over 
the former plan, it was very imsatisfactory because of loss of 
writing practice time for the pupils who were using the writing 
hour as a study period, and it was therefore abandoned. 

Inasmuch as each teacher had elementary, mediocre, and 
advanced pupils in her room, it was decided to form three adja- 
cent rooms into a unit, arrange the programs so that the writing 
hour of the three rooms would come at the same time, and have 
all the elementary pupils of the unit go to one room, the mediocre 
pupils to another, and the advanced pupils to another. This was 
done as an experiment, and the advantages of the new plan were 
evidenced at once by greater interest on the part of both teachers 
and pupils, and in the very marked improvement in the writing 
of the pupils of each group of the unit. 

Then the promotion feature suggested itself and a definite 
time once a month was named for the promotion of the best 
writers (up to ten) of each group of the unit. The best writers 
of the highest group when promoted were seated in the lowest 
room of the unit and allowed to use the writing period for the 
study of other subjects, or for story reading. Some even served 
as demonstrators or "helpers" in the elementary group. 

From this nucleus of a three-room unit, the unit plan has 
expanded until at present seventy of our schools have three- 
room or four-room units in grades from four to eight, inclusive, 
and other schools are adopting it as fast as the writing depart- 
ment can organize the work. 

The three-room grouping in a twelve-room school is here 
used to illustrate the operation of the unit plan. 

Rooms 1, 2, and 3, representing seventh and eighth grades, 
compose Unit 1. Rooms 4, 5, and 6, representing fifth and 
sixth grades, compose Unit 2. Rooms 7, 8, and 9, representing 
third and fourth grades compose Unit 3. The first and second 
grades are not included in the unit plan of practice. 

Each unit is independent of the other imits and the plan in all 
the units is the same as that here illustrated and described. 

Figure 1 shows the seating at the time of organization. Class 
2 is in Room 2; Class 3, in Room 3; Class 4, in Room 1. In 
classifying pupils Room 1 should be reserved for the poorest 
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writers and for those who by promotion may be advanced from 
Room 2 to the exemption class (Class 1). When possible it 
will be well to make the elementary class of Room 1 smaller than 
the other classes, so that the teacher may give individual aid to 
the pupils of this class. The reason for placing the lowest class in 
Room 1 at the beginning of the term is to permit this room to 
become the highest room at the end of the term. This condition 
wiU result from promotions. It is indicated in Figure 3. 

Figure 1. the seating of pupils at the time of organization. 
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Figure 2 shows the seating after the first promotion. Ten 
pupils are here taken as an example of the number promoted from 
each room to the next higher room. 
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The exemption pupils, Class 1, seated on the left-hand side 
of Room 1, temporarily excused from penmanship practice, are 
permitted to use the writing time as a study period, or for supple- 
mentary reading. There is littie probability that the writing of 
these pupils will deteriorate, because to remain in the Exemption 
Class, they must keep their daily writing up to a satisfactory 
standard. 

Figure 3. the seating of pupils apter their promotion 
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Figure 3 shows the rooms of the unit after the third promotion. 
The reader is to understand that a second promotion has advanced 
an additional ten pupils from each room to the next higher room 
and that now a third promotion advances a third group of ten 
pupils in a similar way. This makes thirty exempted pupils in 
Room 1 as shown in Figure 3. The elementary class (Class 4) 
has been eliminated and the pupils of the Exemption Class 
(Class 1) are ready to take up advanced penmanship practice. 
Now the best writers are in Room 1. Class 1 is now in Room 1; 
Class 2, in Room 2 ; Class 3, in Room 3. The rooms will retain this 
order until the end of the term. 

The exempted pupils (Room 1, Class 1) are now ready to 
take up advanced practice. When the seats of Room 1 are 
filled, the Exemption Class is formed in Room 3. If this condition 
arises at all it will be found late in the school year, and the mem- 
bers of the Exemption Class may then be excused for the remain- 
der of the term. 
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The condition existing after the exempted pupils in Room 1 
have resumed practice and certain additional pupils of this room 
have been exempted and seated in Room 3 is shown in Figure 4. 

It will be seen that this plan precludes the possibility of con- 
gestion and that only those who can afford to do without the 
writing practice are exempted from it. 

Owing to the varying sizes of desks, two-room units are sug- 
gested for buildings of eight rooms or less; three-room units for 
buildings of from nine to eighteen rooms; four-room units for 
buildings of eighteen rooms or more. 

When possible the units should be formed so as to avoid making 
it necessary for the children to pass from one floor to another. 

On a floor of five rooms, a three-room unit and a two-room 
unit may be organized, and on a floor of seven rooms, a four- 
room unit and a three-room unit may be formed. 

Figure 4. final plan of seating 

Room 1 Room 2 Room 3 

Ad\;anced Course Upper Interhedi ate Lower Interciediate 
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O Average Pupils Exempt Pupils 

® Candidates for PromoKon lj Vacant Seats 

One of our principals has commented on the Unit Plan as 
follows: 

The xinit plan is advantageous because it gives the pupils who have not 
had sufficient elementary training in writing a chance to acquire this training, 
thus enabling them to strengthen their foimdation, and with a stronger 
foundation to increase their ability to write. 

The best writers, if intermingled with the poorer writers, are given so 
little attention that they often form incorrect habits which would have been 
avoided if more attention had been given them. The unit plan gives all 
pupils the same amount of supervision and allows them to imdertake work 
which is on the level with their ability, thus encouraging both good and poor 
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pupils to put forth their utmost effort. It also stimulates interest in the 
poorer writers in that they work to obtain a place among the best writers, 
whereas formerly the poorer pupils lost this interest because they were 
discouraged when comparisons were made with the better writers of the 
class." 

As a result of our experience with this new plan of practice, 
some interesting facts have come to light. 

1. The percentage of "failures" is negligible. 

2. The percentage of good vrriters among the boy^ is greatly 
.increased and in many cases they equal or excel the girls in writing 

3. The children are able to complete their formal practice 
much earlier in the course than formerly. 

4. The supervision is greatly simplified. Formerly our writing 
department consisted of seven members; now it has three. 

5. The teacher's problem of instruction is greatly simplified, 
and she is able to render not only more efficient aid to each pupil 
but to render it to a much larger number of pupils. 

6. The penmanship is motivated without the aid of award 
certificates or prizes of any kind. 

7. The principal's supervision of the writing is systematized. 
During the vrriting period of half an hour he may visit three rooms 
and find the pupils graded according to their skill in penmanship. 

8. The imit plan admits of introducing into the advanced rooms 
of the unit composition and story vrriting in which the principles 
of correct writing may be made to function. This kind of practice 
furnishes the connecting link between formal vrriting practice 
and daily written work. 




APPLICATION OF SCIENTIFIC METHOD IN 
EVALUATING THE SUBJECT MATTER OF 

SPELLERS* 

Clifford Woody 
UmoersUy of Washington 

Within the last decade the dominant note in educational theory 
has been the social point of view — that the needs of society should 
furnish the end points of education and should serve as a basis 
for the selection of subject matter. This philosophy has been 
urged as applicable to all phases of educational activity and the 
insistence on its application has resulted in many recent investiga- 
tions to determine scientifically the needs of society and the conse- 
quent subject matter. In no field have these investigations been 
more fruitful than in spelling and the educational theorist can 
look with great satisfaction upon the scientifically determined 
lists of most commonly used words representing the social need 
for spelling. But the realization of his hope has merely begun, for 
these scientifically determined lists of most commonly used words 
will have little influence until they have been incorporated into the 
spellers which are used throughout the length and breadth of this 
country, since the textbook has become such a dominant force in 
the life of the American teacher that it tends to determine 
the aims, the subject matter, and the method of instruction. The 
use of the properly constructed textbook then is the real answer to 
the theorist's demand for emphasis on the social point of view. 

The present study was imdertaken to show the possibility of 
evaluating the subject matter of spellers and of scientifically 
selecting a book having its vocabiUary made up of the most 
commonly used words. It represents a comparison of the Ander- 
son list of most commonly used words — a list containing 3,105 
words used S or more times selected from the 361,184 running 
words which composed the contents of 3,723 business and social 
letters written by adults — and the vocabularies of five widely used 

*The statistical tabulations utilized in this article wexe made by Frank S. 
Salisbury and the author is indebted to him for the privilege of using them in this 
article. 
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spellers: 1) Champion Spelling Book,^ 2) Peirce Spellers ,* 3) Mer- 
riU SpeUer* 4) Aldine SpeUersf^ S) The Child's Own SpeUing 
Book.* The Anderson list* was selected because it represents the 
latest and most comprehensive of all the attempts to select the 
most commonly used words and includes a very large percent of 
the Ayres and Pryor lists. The first three spellers mentioned were 
selected because they are widely used in the state of Washington; 
the fourth one, because the preface indicates that the vocabulary 
researches have been utilized to a considerable extent in the word 
content of the book; the fifth one, because its subject matter 
stands as the direct product of a study of children's writing 
vocabularies. In making these comparisons, the subject matter 
of the different spellers was the only factor taken into considera- 
tion — no attention being given to physical features of the books, 
provisions for review, suggestions for teachers, suggested methods, 
gradation of words, or price. It is true that a complete survey of 
the books demands that all these factors be given due considera- 
tion but in the selection of a speller it is assumed that the spelling 
vocabulary is of primary importance. 

In making the tabulations the words of the Anderson list were 
transcribed onto three by five inch cards — one word being placed 
on a card — and the cards were arranged alphabetically, indexed, 
and filed. Word by word, the vocabulary of each speller was 
checked with the words of the Anderson list. Records were 
made of the words common to a particular speller and to the list, 
of the words that were in the list but not in the particular speller, 
and of those words that were in the particular speller but not in 
the list. Hereafter reference will be made to these groups of 

^ Hicks, W. E. Champion spelling book for public and private schools. New York : 
American Book Co., 1909. 2 pts. 

« Peirce, W. N. Peirce spellers. New York: Ginn & Co., 1912-13. 2 bks. 

< Wilson, J. O. MerriU speller. New York. Charles £. Merrill, 1912. 2 bks. 

^Bryce, C. T. and Sherman, F. J. Aldine spellers. New York: Newson&Co., 
1916. 4 bks. 

•Jones, W. F. Child's own spelling book. Pierre, S. D.: Capital Supply Co., 
1915. 2 bks. 

* Anderson, W. N. The determinalion of a spelling vocabulary based upon written 
correspondence. Master's dissertation. University of Iowa, 1917. This list b sub- 
stantially reproduced in £. J. Ashbaugh's loufa spelling scale for grades II to VIII 
(University of Iowa Extension Bulletin, no. 34-36, September 1 — October 1, 1919). 
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words as "overlap" words, "list only" words, and "speller only" 
words. 

Wherever a word in the list occurred more than once in a 
particular book the fact was noted and in estimating the amount 
of overlapping such a word was given but a single count. It was 
originally intended to record the repetitions for the "speller only" 
words, but since the primary interest of the study lay in the over- 
lapping of the spellers with the Anderson list and since the repeti- 
tion of the "speller only" words would have no bearing on the 
problem save on total number of words in the different books, 
the amount of repetition was estimated as existing in the same 
ratio as the repetition in "overlap" of the list and a particular 

TABLE I. GROSS COMPARISONS OF THE FIVE SPELLERS WITH THE 

ANDERSON LIST 



Spellers 


Grades 


Total 

Words 

in Book 


"Speller 
Onl/' 
Words 


"Over- 
lap" 
Words 


"List 
Only" 
Words 


Percent 
of Book 
Repre- 
sented 

by 

"Overlap" 


Percent of 
Anderson 

List 
Included 


/ 


2 


3 


4 


5 


6 


7 


8 


Champion 


3-8 


6,270 

(5,872) 


4,846 

(4,430) 


1,424 


1,681 


22.7 
(24.2) 


45.9 


Peirce 


3-8 


2,991 
(2,862) 


2,207 
(2,078) 


784 


2,321 


26.2 
(27.0) 


25.2 


Merrill. . . 


3-8 


5,636 

(5,550) 


3,959 

(3,873) 


1,677 


1,428 


30.0 
(30.0) 


54.0 


Aldine. . . 


1-8 


4,786 
(4,436) 


2,801 
(2,451) 


1,985 


1,120 


41.5 
(44.9) 


63.9 


Jones 


2-8 


4,532 


2,637 


1,895 


1,210 


41.8 


61.3 



The figures without parentheses in columns 3, 4, and 7 are only approximately 
true, for as was noted previously only the gross number of "speller only" words was 
obtained, the amount of repetition therein being disregarded. Hence a slight source 
of error in the figures of these columns. The figures in parentheses in the columns 
represent the same results on the assumption that the repetition in the "speller only" 
words is the same as in the "overlap" words. 
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speller. Record was also kept of the particular grade in which 
each word in each speller was taught. 

The facts concerning the overlapping of the five spellers and 
the Anderson list are presented in Table I. The first column of 
this table gives the name of the speller; the second column, the 
grades in which it is supposed to be used; the third column, 
the total number of words in the book; the fourth column, the 
number of "speller only'' words; the fifth column, the number 
of "overlap" words, i.e., words common to the speller and the list; 
the sixth column, the "list only" words, i.e., words in the Ander- 
son list but not included in the book; the seventh column, the 
percent of the total number of words in the speller represented 
by the "overlap" words; the last column, the percent of the 
Anderson list incorporated in the speller. 

Table I makes it evident that if the number of words included 
in the "overlap" (column 5), or if the percent of the Anderson 
list included in the "overlap" (colunrn 8) is taken as a basis of 
comparison, the relative standing of the books is as follows: 
Aldine first, with 1,985 "overlap" words representing 63 . 9 per- 
cent of the Anderson list; Jones second, with 1,895 "overlap" 
words representing 61.3 percent of the Anderson list; Merrill 
third, with 1,677 "overlap" words representing 54.0 percent of 
the Anderson list; Champion fourth, with 1,424 "overlap" words 
representing 45.9 percent of the Anderson list; Peirce fifth, with 
784 "overlap" words representing but 25.2 percent of the Ander- 
son list. 

To the practical minded superintendent the above compari- 
son is fair and just for since the speller determines to so great an 
extent what words will be taught it is logical to insist that the 
subject matter of that book is best which contains the greater 
number or percent of the commonly used words. However, 
the Champion, the Peirce, and the Merrill, as shown in column 2, 
are intended for grades in to vm — ^inclusive; the Aldine, for 
grades i to vm inclusive; and the Jones, for grades n to vin 
inclusive. Consequently one might expect differences in the 
total number of words in the spellers and more chances of over- 
lapping in those books containing the most words. Column 3 
shows that the books do vary greatly in the total number of words 
included — from 2,991 in the Peirce speller to 6,270 in the Cham- 
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pion — but comparisons with other columns in the table show little 
relation between the number of words in the book and the amount 
of overlapping. Column 7 shows that in the Aldine and Jones 
spellers the "overlap" is a little over 40 percent of the total 
spelling vocabulary while in the other spellers it ranges from 22.7 
to 30 percent. Such facts tend to show the superiority of these 
first mentioned spellers. 

To eliminate the charge that it is unfair to compare books 
primarily intended for grades in to vin inclusive with those 
intended for more than these grades, comparisons were made 
disregarding the word lists in the Aldine and the Jones spellers 
intended for grades below the third. From Table II representing 
such comparison it is seen that the Jones and Aldine spellers still 
rank very high in the number and percent of the Anderson lists 
included in the "overlap" but the Merrill speller ranks higher. 
When comparison is made of the percent of the book total repre- 

TABLE n. COMPARISON OF THE FIVE SPELLERS WITH THE 
ANDERSON LIST ON THE BASIS OF THE WORD LIST FOR 

GRADES ni TO VIH INCLUSIVE 



Speller 


Grades 


Total 

Words 

in Book 


"Speller 
Only" 
Words 


"Over- 
lap" 
Words 


"List 
Only" 
Words 


Percent 
of Book 
Repre- 
sented 
by "Over- 
lap" 


Percent 
of Ander- 
son List 
Included 
in "Over- 
lap" 


i 


2 


J 


4 


5 


6 


7 


8 


Champion 


3-8 


6,270 
(5,872) 


4,846 
(4,430) 


1,424 


1,681 


22.7 
(24.2) 


45.9 


Peircc 


3-8 


2,991 
(2,862) 


2,207 
(2,078) 


784 


2,321 


26.2 
(27.0) 


25.2 


Merrill... 


3-8 


5,636 
(5,550) 


3,959 
(3,873) 


1,677 


1,428 


30.0 
(30.0) 


54.0 


Aldine. . . 


3-8 


3,888 
(3,400) 


2,429 
(1,941) 

• 


1,459 


1,646 


40.0 
(43.0) 


47.0 


Jones. . . . 


3-8 


4,008 


2,524 


1,484 


1,621 


37.0 


47.7 
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Hrntcil by the "overlap" then it is clear that the Jones and the 
AUIlno HpeUors contain a much smaller percent of words of "low 
prolmhillty of usefulness." 

ThuH fur all comparisons have been made with the Anderson 
lUt UH u whole: but, as was pointed out by Ayres in his attempt to 
Ulrutify the two thousand most commonly used words, the 
({renter the number of words the more they vary according to 
the Mubjeet uuUter under consideration, and the less reliable the 
i uiu luitiou nlumt their being most commonly used. Consequently 
the Audernon list was divided into six parts. Part I consists of 
the ?v> words that make up the first five deciles of the Anderson 
lUt, I.e. I tluKHe words which with all their repetitions account for 
Iwe tenths of the 361,184 nmning words that are contained in the 
Auvler>*ou source material. Part II consists of the 213 words in 
the nUth tuul seventh deciles. Part III consists of the 303 words 
ol the elKhth ticcile. Part IV consists of the 849 words of the 
hint h deelle ; Part V consists of 1 ,661 words of the tenth decile which 
were usihI 5 or more times. Part VI consists of the remaining 
0,118 words of the tenth decile — those words in the Anderson 
Mouri'e uuitcrial but not listed as most commonly used words. 

Ihe number of words in the different parts together with the 
variation of the number of times the different words were used 
wre presented in tabular fomr below. 

rAHLK III. SHOWING NUMBER OF WORDS IN THE DIFFERENT 
PARTS AND THE VARIATION IN THE NUMBER OF TIMES 

THE VARIOUS WORDS USED 



Number of Parts 


Number of Words 


Range in Number 
of Times Used 


I 


79 


677—11,893 


II 


213 


185-^75 


III 


303 


79—185 


IV 


849 


24—79 


V 


1,661 


5—24 


VI 


6,118 


1—5 



A glance at Table III shows that each part varies in two 
respects, the number of words and the number of times the words 
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were used. It is furthermore noted that where there are few words 
in a part they are used many times and where there are many 
words they are used few times. "Few words and many times 
used" signifies most commonly used words, and "many words 
and few times used" signifies words of low probability of use- 
fulness. Consequently that book which contains the highest 
number and percent in the first parts of the list [will contain the 
most of the commonly used words. 

Table IV, showing the number of words in the five spellers 
that are found in each of the six parts of the Anderson source 
material, reveals great variation among the different books in the 
number of words found in the respective parts. It is interesting 
to note that the Aldine and the Jones spellers usually contain 
more words in Parts I to V inclusive and fewer words in Part VI. 
These facts stand out more prominently in Table V, which pre- 
sents the figures for Parts I to V inclusive reduced to percents. 

TABLE IV. NUMBER OF WORDS IN THE FIVE SPELLERS THAT ARE 
FOUND IN EACH PART OF THE ANDERSON SOURCE MATERIAL 



Speller 

with Book 

Total 


Parti 

(79 
words) 


Part II 

(213 
words) 


Part II 1 

(303 
words) 


Part IV 

(849 
words) 


PartV 
(1,661 
words) 


Part VI 
(6,118 
words) 


Champion 
5,872-6,270 


19 


113 

f 


181 


452 


659 


4,500-4,800 


Pcircc 
2,862-2,991 


8 


52 


88 


255 


381 


2,000-2,200 


Merrill 
5,550-5,636 


30 


153 


216 


466 


812 


3,775-3,950 


Aldine 
4,436-4,786 


79 


118 


206 


618 


964 


2,500-2,800 


Jones 

4,532 


76 


200 


255 


569 


795 


2,636 







Table V should be read as follows: The Champion speller, 
which as a book included 45.9 percent of the 3,105 words of the 
Anderson list, contained 24 percent of Part I, S3 percent of 
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TABLE V. PERCENT OF TBE ANDERSON LIST AND OF THE 
FIRST FIVE PARTS CONTAINED IN EACH SPELLER 

(Computed from Table IV) 



Speller with 
Percent of 
Anderson 

List Included 


Part I 

(79 words) 


Part II 
(213 words) 


Part 111 
(303 words) 


Part IV 
(849 words) 


PartV 
(1^661 words) 


Champion 
45.9 


24 


53 


60 


53 


40 


Peirce 
25.2 


10 


24 


29 


30 


23 


Merrill 
54.0 


38 


73 


71 


55 


49 


Aldine 
63.9 


100 


55 


68 


73 


58 


Jones 
61.3 


96 


94 


84 


67 


48 



TABLE VI. SCORES WHEN THE PERCENTS OF OVERLAPPING GIVEN 
IN TABLE V ARE WEIGHTED ACCORDING TO THE NUMBER OF 

DECILES IN EACH PART 



Speller 


Parti 
(500) 


PartU 

(200) 


Part III 
(100) 


Part IV 
(100) 


PartV 
(50) 


Total 
(950) 


i 


2 


3 


4 


5 


6 


7 


Champion 


120 


106 


60 


53 


20 


359 






Peirce 


50 


48 


29 


30 


12 


169 






Merrill 


160 


146 


71 


55 


25 


457 






Aldine 


500 


110 


68 


73 


29 


780 






Jones 


480 


188 


84 


67 


24 


843 
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Part II, 60 percent of Part III, S3 percent of Part IV and 40 per- 
cent of Part V, etc. This table merely serves to reemphasize 
the superiority of the Jones and Aldine spellers when checked 
against the Anderson list of commonly used words. 

To give a more complete evaluation of the books on the basis 
of their selection of commonly used words, the parts were weighted 
according to the number of dedles or the part of a decile which 
the words therein comprise. Table VI showing the results of 
such weightings is derived from Table V by multiplying the per- 
cents for Part I by 5, i.e., the number of deciles in that part; 
the percents for Part II by 2 ; for Part III by 1 ; for Part IV by 1 ; 
for Part V by ^. By this system of weighting the perfect scores 
for Parts I to V respectively are 500, 200, 100, 100, and SO; and 
the perfect score for the five parts taken together 950. 

The total scores as given in column 7 show that the spellers 
should be ranked as follows: Jones, first; Aldine, second; Merrill, 
third; Champion, fourth; Peirce, fifth. 

It should be pointed out that even though the Jones speller 
is given first rank according to the weighted scores, the Aldine 
speller has a higher score in three of the five parts. When the 
books were ranked according to the percent of the Anderson 
list included (Table I), the Aldine speller excelled the Jones by a 
narrow margin. When the books were ranked on the basis of 
the word lists for grades in to vni inclusive (Table II) the Jones 
speller excelled by seven-tenths of one percent. All of these facts 
tend to show that little difference exists between these two spellers, 
and that superintendents and teachers would make little mistake 
in choosing either book, so far as spelling vocabulary is concerned. 

On the whole, this study shows a great range in the size of the 
spelling vocabulary — from 2,991 words in the Peirce speller to 
6,270 words in the Champion speller. It also shows the significant 
fact, so far as these books are concerned that little relation exists 
between mere size of vocabulary and the number of most com- 
monly used words included. For example the Champion speller 
with 6,270 words contains but 45.9 percent of the Anderson list 
while the Jones speller with 4,532 words contains 61.3 percent 
of the list — which fact signifies that the selection of a spelling 
vocabulary is something more than merely collecting so many 
words. The study also shows that the ratio of the number of 
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i'omincmly uned words to total number of words in the hwA. 
varlrM frcm\ 41.8 percent in the Jones speller to 22.7 percent in 
tht) (*lmn\plon HiH'ller. In cold facts these figures mean, if we 
nmy Htift^ly ufKUc from the basis of the Anderson list, that from 
AM lo 77 percent of the time devoted to spelling within the public 
Ht luuil U Mpeut upon words not commonly used. Is not one cause 
of \\w churHc Honictimes heard today that children are not efficient 
ill HpiilliuH il\ie to the fact that we teach the children one list of words 
in Ihp mHooI room <m</ the world expects them to spell another list 
u^htiH Ihp^ hm^p Ihf sth^ol room? 

*lho tttvidy Hhowj* that the Jones and Aldine spellers rank high. 
Hi* iuwtter whether considering the number or percent of the 
AiuliM'titMi \U\ liuludetl. the ratio of the words of the Anderson 
lUl Id the lott^l number of words in the book, or the final scores 
duluiiuinetl thrmiKh the adopted system of weighting the words 
dtdinlihg ti» theh' inmition in the Anderson list. When only the 
Viu uliuhu le>4 Intended for grades m to vm inclusive are compared 
\\\\\ Meiiill Mpeller includes a higher number and percent of the 
littt, \\\\\ \\\U speller Is surpasseil by the previously mentioned 
liutikti in all iither phases considered. 

(hie nuiMt conclude then that the Jones and Aldine spellers 
are niiperior to the other three spellers under consideration as far 
au choice of viU ahulary Is cimcerned. This does not mean that 
they are superior in iUher resjvects, nor does it mean that they are 
superior to other spellers on the market today, especially those 
which have just recently come from the press. The selection of 
a speller, to he wholly scientitic, should take account of all spellers 
and all aspects of the ditYerent spellers; but this was impossible 
in the present investigation. Such investigations require time 
and energy; hut it can safely be predicted that until they are 
made we shall continue to select books, which cause children to 
spend their time upi)n wonls which they will probably never use, 
and we shall contiiuie to select lHM>ks incorporating inferior 
methods. Proper utilisation of scientific method in the selection 
of spellers or other textbooks will hasten the application of the 
best established psychological principles and will guarantee prog- 
ress in the realization of the social point of view. 




THE EDUCATIONAL OBJECTIVES OF THE ILLINOIS 

HIGH SCHOOL CONFERENCE 

H. A. HOLUSTER 
High School Visitor, University of lUinois 

The High School Conference which meets annually at the 
University of Illinois has taken as its definite task the imiver- 
salizing of high school education for the state. Naturally the 
carrying out of such a project calls for the removal of numerous 
obstacles and the making of important readjustments. These 
preliminary steps call for much investigation along several 
different lines for the accomplishment of which a number of 
committees have been named. These committees are to operate 
imder the direction of a central committee from the faculty of 
the College of Education of the university. 

The studies for which committees have been chosen thus far 
are as follows: 

1. Readjustments needed in the high school curriculum and 
in that of the schools leading to it. 

2. Existing conditions in the state for the training of teachers 
and needed extension of such facilities. 

3. Continuation or part-time schools — ^where needed, of 
what character, and how they are to be provided. 

4. The possibilities of the all-year school — ^is it desirable 
and practicable for Illinois. 

5. Provisions to be made, other than those now existing, for 
compulsory attendance; and the extent to which there may be 
necessity for subsidizing families economically incompetent in 
order to keep their children in school. 

6. The need of extending facilities for high-school education 
through the organization of community high schools; the defining 
of an economical high school, and the problem of transportation 
of pupils. 

At the last session of the conference a seventh committee 
was provided for — a committee for the study of the method 
of readjusting the curriculum as it affects the economics of 
instruction and the time and sequence]|elements of the problem. 
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It seems fitting at this time to discuss in brief detail what is 
involved in the way of investigation and research in these various 
committee assignments. Such a discussion seems all the more 
desirable in view of the fact that some of those interested in 
the movement seem not to be able to visualize the entire situa- 
tion with sufficient clearness to enable them to see the neces- 
sities calling for such an extended survey. Let us take the 
problems, then, in the order named above. 

The demand for curriculum readjustment seems to be uni- 
versal, and just now there is apparently a tendency to get at the 
real objectives of education as a basis for such readjustment. 
The logical order seems to be: the determination of objectives, 
the selection and arrangement of materials and processes best 
calculated to become effective in their attainment, and the 
method to be pursued in the use of such materials and processes. 
A committee of the N. E. A. has given us a statement of objec- 
tives. But the presentation by the chairman of our conference 
committee, Mr. R. L. Sandwick, seems to be a better statement 
or classification for our purposes. 

The next step, the selection and arrangement of subject 
matter and processes, is a far more complicated and difficult 
problem. We have been going on from the very beginning of 
our common school system with a process of imorganized accumu- 
lation of materials, both new and traditional, in a hopeless jumble. 
Like a retail dealer of dry goods and notions who could never 
manage a successful "clearance" sale we have been encumbering 
the shelves and attic of our educational shop with old and out- 
of-date stuff, much to the disadvantage of any effective "display" 
of the new. Is it not high time that we should take an inventory 
of the "goods" on hand with reference to the needs of our "trade," 
arranging them in the most advantageous way possible, and 
disposing of all non-essential and out-of-date stuff even at a 
sacrifice if necessary? 

Such a process of weighing and testing will require much 
patient work; but there is no other real readjustment to be had. 
We shall need to apply mercilessly the tests which a clear imder- 
standing of our educational objectives should make possible. No 
might-have-beens or vague possibilities of the future should 
remain to mar our work. It is evident, then, that those who 
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are to participate in the testing process must first get dearly 
in mind the fundamental objectives of school education as 
determined by life needs. It will be necessary, also, that a 
considerable number of our best qualified teachers be available 
for service in this educational inventory. 

The third step in curriculum reconstruction, as affecting the 
economics of instruction and the time and sequence relations, 
must, for the most part, wait upon the progress of the second 
step. But there is here a preliminary work to be done which 
may well employ the attention of such a committee until such 
time as it may be able to act jointly with the committee on 
readjustment of content of the curriculum. This preliminary 
study by a committee on method should result in a classification 
of principles of general method together with an attempt to 
evaluate them on a basis of accomplishment. In making such a 
study it will be desirable as far as possible to avoid mistaking 
the special application of a principle, at a given time or under a 
given name, for an entirely new principle of method. 

The second study, that of teacher training, was clearly out- 
lined in a general way in the preliminary report of the committee 
last November. The necessity of the situation was made very 
clear. There remains to be made now a careful survey for the 
purpose of determining the number and character of teachers 
necessary to carry through successfully any plan of readjustment 
and extension of high-school education that may result from the 
work of the first committee. In order to do this it is desirable, as 
in the case of curriculum reconstruction, to take into considera- 
tion the needs of the elementary schools as well as of the high 
schools. This investigation will be conducted under the direc- 
tion of Dr. 6. R. Buckingham, acting for the committee of 
which President Felmley is chairman. The study will include 
not only the sources of teacher supply but also their distribu- 
tion, salary, tenure of service, and preparation for their work. 

The third committee having in hand the problem of con- 
tinuation schools is now facing a difficult problem. We already 
have a law on the statute books providing for the progressive 
and obligatory establishment of such schools until all boys and 
girls of ages up to and including eighteen are in attendance. 
But we do not know where or what kind of continuation schools 
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Tte fourth committee has a ^tmiliar thou^ newer phase of 
the problem to consider — the all-^year school and its ad^tability 
to our needs in Illinois^ Fix^ ot all such a committee should 
ascertain how this plan is working where it is already in use. 
It should 5tud>" the various vvcattons in order to see how and 
where, as a type ot contiauatioa school, it wfll best serve the 
interests of individuals and of ch^? state. It is possible that this 
type of school may be just the one needed for children of the 
rural districts especially. 

Another problem closely aUied to the third and fourth, and 
one which may well be handled cooperati\"ely by these three 
committees, is the problem of cv>mpuIsor\- attendance and of 
economically incompetent families, as assigned to committee 
number dve. Here again methods of motivation and waj's and 
means of effectual enforcement of law must be seriously con- 
sidered. This study should include a thorough investigation of 
compulsory- attendance laws in other states, the maimer of their 
enforcement and the results attained. The economic problem 
involved in the case of families lacking adequate adult workers 
as bread winners needs to be carefully surveyed and the most 
constructive treatment possible pro\-ided. 

It is useless to consider any plan for universalizing high-school 
education without providing schools sufficient in number as well 
as in character to take care of all classes of pupils who should 
attend. ToUhis end the sixth committee named above was 
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provided. Naturally the first step should be to locate the sec- 
tions where suitable high-school facilities are now lacking and to 
determine approximately the number and character of schools 
needed. TUs will mean a careful survey of the state for the 
purpose of ascertaining where there are children of high-school 
age — fourteen to eighteen — for whom there is at present no 
suitable high school available. The lack may be due either to 
the absence of any school near enough to be available or to the 
lack of any fitting type of instruction which local interests or 
predominant individual inclination seem to require. 

The study of this committee also involves the effort to deter- 
mine when a high-school organization is economically justifiable. 
This would imply some way of providing for a possible few who 
would otherwise be without high-school advantages. Thus the 
problem of transportation of pupils living at a distance too great 
for walking also falls to this committee. 

It appears, then, that a very complete survey of the situation 
is proposed and already in progress. Purposely we have confined 
this to problems purely educational. The great problem of 
financing education is left for some one to take up as a separate 
study. But even such a separate study must, in some measure, 
be able to take into consideration many if not all of the results 
to come from the work we have outlined for our six committees. 
Certain it is that the time has come for all of us to consider our 
educational needs in the light of our economical limitations as 
related to education. We must insistently demand the elimina- 
tion of waste of materials, waste of teaching talent, waste of 
pupil time, waste from unsanitary conditions and practices and 
from physical defects and disease. 

Such a plan of reconstruction our present situation demands. 
To dally with it, to halt because of its diflBiculties, is only to 
postpone it to a later day and to make the task more difficult. 
It is a task whose alternative is social decadence. With all of 
our varied studies, therefore, there needs to be a constant effort 
to enlist the thought and the intelligent comprehension not only 
of those who teach but of all leaders of thought in all communities 
of the state. 

One of the most gratifying elements of the above program is 
to be seen in the fact that any significant progress made along 



13^ TXariAL 3DlICAr321i:\L Iffq^^HC^ VaL L 39. 2 



:fie Ims judnnsi -vnl Trmg its ^IWIl rewancL The sdiools will 
-jcjoas: '3y ixtv jftrrazn:: jnuie if jnLy 'ly vme at the committees, for 
j&L riisse -iniinir-H* * -mh'wmn^ icuiii 5ar Tol needs in our educa- 
:&iiciL s^sasiL Si -mmgjwr -m^ >rr;mm ju^ abfecnve fully or not 
s&iiL in X nessire. ioctrsed. But it we be&ffve. with all our 
Sw in X lew imi 'jerirr JLnesaoiisn. we dlmlL by peisistiiig, 
xciain :3e iii^er jvivL 




PSYCHOLOGY OF THE EDUCATIONAL "STANDPATTER" 

Some are educational "standpatters" because they have never 
done any thinking, others because they are held captive by the 
thinking they once did. We are here concerned only with the 
latter. Sometimes he is a scholar in academic lines but has 
reached his saturation point. The mind has crystallized pre- 
maturely. A negativistic attitude toward the new is one of the 
symptoms. Such an individual becomes hypercritical toward 
his contemporaries. He considers their work either as cheap 
and shoddy or else as nothing but an amplification of something 
from one of the favorite authors of his youth. The pose of dis- 
dainful superiority is cultivated. He cuts himself off from his 
fellow workers and develops the shut-in personality. 

One wonders whether such persons, notwitibstanding the 
scholarly attaiimients which they sometimes possess, have not 
after all a fundamental intellectual defect. Perhaps it is a lack 
of constructive imagination that robs them of open-mindedness. 
Their thinking seems to have no anticipatory reference. They 
are unable to see how things point. Th^y ran nnt gpp thp npw 
day that is dawning in education because t heir intellectual heads / mjc. <- ^ 
have been set onbafkuacds. 

What a relief to turn to the educational worker who instead of 
specializing on the destruction of the new, just because it is new, 
has a never failing sense for the importance of a novel contribu- 
tion, even if it is imperfect or in part erroneous. Instead of 
wasting his energies in the attempt to overthrow a reading test 
or a handwriting scale or a scale for grading English compositions 
he tries to develop something better. While others are pro- 
claiming that intelligence is too complex to be measured, he 
devises an instrument to measure it. While others are proving 
the impossibility of scientific vocational selection he devises and 
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Standardizes a trade test that works. Another in the field of 
school administration surveys his own schocd and remodels his 
corriculum and methods in the light of the results, while neighbor- 
ing superintendents and prindpab are inveighing against the 
pretensions of measurement enthusiasts. 

This is not a plea in behalf of educational science. That is on 
its way and will not be turned back. It is rather a plea to the 
young men in education, whether in the academic or the practical 
field, to direct their talents along profitable lines. It would also 
point out the reflex effects upon the worker of the lend-a-hand 
attitude, as contrasted with the attitude of purely destructive 
criticism. The one attitude favors prolonged intdlectual plas- 
ticity, the other brings premature hardening of the intellectual 
arteries. The one means professional growth, the other pro- 
fessional death, not less sure because it may be insidious and slow. 

L. M. T. 

THE VALUE OF STANDARDIZED SILENT READING TESTS 

The average silent reading rate of eighth grade pupils is 
approximately 240 words per minute for continuous material. 
Scientific investigation is revealing that this rate may be greatly 
increased by the application of appropriate methods. On the 
basis of data already secured, it is conservative to say that this 
rate could be increased 25 percent. As a matter of fact, it is 
even conservative to say that it could be increased SO percent. 

Silent reading is used as a tool in practically all subjects studied 
in the high school or in college. The pupil who is equipped to 
read at the rate of 300 words per minute has a decided advantage 
over the pupil who is equipped to read only 240 words per minute. 
It means that the pupil who reads more slowly either must spend 
more hours upK)n his work or do less work. 

Of two pupils who spend an equal number of hours upon their 
work in high school, the one who reads at the rate of 300 words 
per minute will accomplish one-fourth more than the pupil who 
reads at the rate of 240 words per minute. This will mean that 
in the course of four years this pupil will do 25 percent more 
work, which approximates the equivalent of an extra year of 
schooling. 
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The data which we have at hand not only shows that the 
rate may be increased, but also that the degree of comprehension 
can be materially iacreased, perhaps to an equal extent. There- 
fore, not only may pupils be trained to read more rapidly but at 
the same time they may be trained to read with increased under- 
standing. Thus, the pupil who has been trained to read at the 
rate of 300 words per minute not only will gain an extra year's 
schooling during his high-school course, but if his training has 
been of the right sort, he will actually do a better quality of work. 

It appears that the use of a standardized test for measuring 
the rate and comprehension of pupils is one method by which 
the rate of silent reading and the degree of comprehension may 
be materially increased. At least, where such tests have been 
used and the results properly interpreted, these dimensions of 
silent reading ability have been increased. Therefore, it is not 
idle to say that by using standardized silent reading tests systema- 
tically, it will be possible to increase the amount of education 
received by pupils completing the high school by 25 percent. 
In fact, as we have already suggested, such a prediction is con- 
servative in view of the facts at hand. 

The fundamental resources of a state are vested in the abilities 
of its citizens. To develop these abilities is to enrich society. 
The increased wealth which may accrue to the nation from the 
effective use of standardized tests of silent reading may be com- 
pared with the abundance that has already resulted from improved 
methods in science. 

W. S. M. 

RESEARCH AND THE PROBLEMS OF EDUCATIONAL 

READJUSTMENT 

The decade preceding the World War was educationally 
notable for the advances it brought along material lines and the 
external aspects of school administration. Large sums were 
expended for school buildings, equipment, and playgrounds. 
New types of schools to meet new needs were created in large 
number. The profession of school administration was bom and 
brought safely through the ills and dangers which always lie in 
wait for an infant profession. 
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But the war has done three thmgs: (1) it has left the schools 
financially embarrassed and has checked, for the time being, 
material progress; (2) it has ruthlessly exposed our educational 
failures; (3) it has given us a host of new educational problems. 

History shows that when poverty-stricken schools face insis- 
tent demands for higher eflBiciency the result is likely to be a 
development along the lines of inner organization, method and 
procedure. This occured after the Civil War; it will occur again. 
A new educational era is upon us. Not for fifty years have the 
problems of education been as fluid as they are today. It is a 
time for conscious self-searching and for conscious decision as to 
the attitude one will take toward the new problems of educational 
readjustment. 

The period following the Civil War marked a renaissance of 
interest in educational method based upon philosophy and 
speculative psychology. Waves of Hegelianism and Herbartian- 
ism swept over the coimtry. Rousseau, Pestalozzi, and Froebel 
were studied and debated. In the period which has recently 
begim questions of educational procedure are again coming to the 
fore, but with the difference that we are now seeking our solutions 
by the methods of science rather than by an appeal to arm-chair 
psychology. Everywhere tradition is being challenged by experi- 
ment. No method or program is sacred enough to escape the 
inquisitive and ubiquitous pedagogical test or scale. By means 
of intelligence scales the material with which the school works is 
subjected to the same cold analysis as the products of farm, 
factory, or mine. Nothing is taken for granted; everything must 
be proved. The spirit of educational research rules the day. 

That much of this scientific endeavor will be ill directed or 
misapplied, and that much which is well directed will prove abor- 
tive because of the complexities of the problems, goes without 
saying. We may find that the conclusions of science no more 
than the conclusions of the a priori theorist can safely be accepted 
with the eyes shut. There may even arise a new type of pedant 
who will be entirely unable to think educationally except in terms 
of zero points, frequency curves, probable errors and mean square 
deviations ! 

Nevertheless educational research has come to stay. The 
only escape from the errors of scientific method is by a more 
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careful and sagacious use of that same method. The best cure for 
the scientific pedant will be such a development of his methods 
as will show finally where the boundaries lie beyond which those 
methods are not for the present applicable. There is little danger 
that opponents of the scientific movement in education will be 
able seriously to retard its progress. There is every likelihood 
that such opponents of the inevitable will lose whatever oppor- 
tunities they might have had to shape the course of modem 
educational currents. 

L. M. T. 

MENTAL AND PHYSICAL AGE IN RELATION TO 
SCHOOL ADMINISTRATION 

Compulsory education laws are driving thousands of children 
to the schools who, imder former conditions, would not have 
attended. The statutes make no distinctions except those based 
upon chronological age and "physical or mental disability." 
It is assumed that when a child is six years of age, he is ready to 
enter the first grade. Many children are ready before tlieir 
sixth birthday, many others will not be ready until later, and still 
others will never be ready at all. If we are going to speak in 
terms of age, let us use the ages which really apply. When we 
say that a six-year-old child is ready for school, we at once get 
into difficulties because of the wide range of both the physical 
and mental abilities of such children. We need a finer adjust- 
ment than chronological age provides. Evidently then, for 
school use we must have a different conception of age. If six 
years is the standard for entrance, we must define it as six years 
physically and six years mentally. Thus we have the conception 
(1) of physical or anatomical age and (2) of mental age. Both 
of these have real application to the work of the school and to the 
competence of children to do the work. 

We can measure physical age and mental age with surprising 
accuracy. It is gradually becoming inomibent upon the school 
to do this. An x-ray photograph of the wrist bones indicates 
clearly their degrees of ossification. A series of standard photo- 
graphs each representing average development for a chronological 
age will permit the matching of each child's photograph against 
the series so that the skeletal development of a child may be 
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determined in terms of years. This skeletal development is a 
reliable index of physical maturity. Almost as good an index of 
physical maturity, however, may be obtained from an examination 
of a child's teeth. Since permanent teeth should normally appear 
in a fixed order and at relatively fixed chronological ages, the 
number and character of these teeth furnish a reasonably accurate 
measure of physical maturity. Anyone can apply this method, for 
the teeth are obviously either present or absent. All one needs 
in interpreting the results of the coimt is a table indicating the 
ages at which the teeth appear in the child whose anatomical or 
physical development is normal. 

Evidence shows that anatomical age corresponds much more 
closely to mental age than does chronological age. But although 
anatomical age is a much safer criterion than chronological age 
as a basis of school procedure, it is insufBicient. In all cases it 
must be supplemented by a knowledge of mental age. After all, 
a child's success in school depends primarily upon his intelligence. 
The means of measuring intelligence are multiplying. The most 
brilliant constructive achievement of psychology and the most 
useful of its many gifts to education has been the Binet-Simon 
Intelligence Scale. This scale reveals in terms of age the men- 
tality of children. It is a "wonderful instrument" although 
critics are agreed that its usefulness in measuring intelligence 
beyond that of the normal child of thirteen or fourteen is relatively 
less than it is for lower degrees of intelligence. 

We are now, however, on the eve of another important applica- 
tion of psychology to education. The Binet-Simon Scale showed 
the possibilities of mental measurement in the schools. It 
remained, however, for the psychologists to devise a means of 
mental measurement which could be applied quickly, cheaply, 
and without the services of a specially trained examiner. Such 
means of measurement are now available. Some of them are 
being commercially distributed. The validity of these "group 
tests" — the extent to which they really measure intelligence — 
and their reliability must be more fully established. But their 
usefulness is now beyond question. They are not substitutes for 
individual tests. They give a reasonably accurate general impres- 
sion. Pupils showing extreme scores should be given the Binet 
test. 
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With knowledge of the mental ages of duldren supplemented 
by knowledge of their anatomical or physical ages, we shall be 
better able to adjust the work of the school to that wide-ranging 
human variabiUty which is everywhere present and which we 
cover with the term "individual differences." 

We are confronted with the necessity for training large masses 
of pupils. Perforce we must organize them into classes. The 
real task of the modem school, therefore, is to reach the individual 
through the group. This can only be done on the basis of a 
grouping according to the things which really determine success 
in school work. 

Boards of education should provide for a survey of at least 
the mental levels of all the children in the schools which they 
control. About twenty percent of the children should receive 
special education of some kind. The intelligence of about ten 
percent is so far below normal that their training must 
consist of activities which call for relatively little mental ability. 
Reading, writing, spelling, and arithmetic, although they are 
subjects ignorance of which is a misfortune, are also subjects 
which children of certain intellectual levels can never learn. If a 
child's mental age is only half of his chronological age, he has an 
intelligence quotient of SO. This will remain relatively fixed. 
Such a child will never become much more than eight years old 
mentally. He cannot learn arithmetic or even enough reading 
and writing to do him any good. If his intelligence quotient is 
70, we may teach him some reading and writing, but it will be 
useless to try to teach him more in arithmetic than the fimdamen- 
tal operations and very simple notions of fractions. Children 
of intelligence quotients of 70 or 80 sometimes reach the high 
school. They take up Latin and algebra although they never 
succeed in these subjects. Indeed, we know that the high school 
as it is at present organized affords no place for children of such 
a degree of men.tality. 

There are, however, a vast number of children whose intelli- 
gence is below normal but not very seriously so. While these 
children can profit by the teaching of the common branches in 
their more elementary form, they should be given considerable 
industrial training for they will recruit the ranks of unskilled and 
semi-skilled labor. We need not suppose that they will be either 
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economically incompetent or imhappy. An increasing amount of 
the work of the world is being done by them; and their rewards — 
at least in wages — are already large, and they are increasing. 

Accordingly, the task of the school is, first, to identify those 
whose lot it will be to serve in these capacities and, second, to 
give them such intellectual training as they can use and such 
vocational training as will fit them to perform competently the 
sort of work they will be called upon to do. The kinds of manual 
work best suited to each mental age has now been worked out in 
considerable detail. A woman of the mental age of seven may 
be taught to do well certain forms of housework, plain sewing, 
rug weaving, lace making, and a number of other occupations. 
A man of the same age may do good housework or laundry work, 
may do "outside work" or teaming, brush making, and bench 
work. In fact, the nimiber of possible occupations for such men 
is rather large. Semi-skilled labor such as some employees in 
stores, policemen, firemen, car men, and some of the lower forms 
of clerical work may be and indeed should be done by persons 
possessing an intelligence inferior to normal, or at least not higher 
than normal. 

At the other end of the scale of intelligence there are some 
eight or ten percent of the children whose gifts are so superior 
that they should not be subjected to the school training which is 
now supposed to be adjusted to the abilities of the normal child. 
Since, in the case of the superior child intellectual ability is pre- 
dominant, he can negotiate the regular course of study in less 
time than can the normal child ; for the regular course of study is 
essentially intellectual in its appeal. Many children, capable of 
completing the elementary school in from four to six years, are 
being unfairly treated and permitted to fall into loose habits of 
study by being required to spend eight years in the elementary 
school. 

Not only should the gifted child progress more rapidly than 
the normal child, but his work should differ also in quality and 
method. Additional problems, more significant relationships, 
supplementary assignments, collateral readings — all the types 
of activities which we would like to carry on in the schools but 
for which the "minimum essentials" permit so little time — these 
should be prominent in the training of gifted children. 
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Yet special provision for gifted children is almost non-existent. 
Without the aid of intelligence tests the gifted child is much less 
frequently identified than the dull or defective child. Superior 
children do not call attention to themselves; they may occupy 
moments of enforced idleness in ways of their own choosing, but 
they are successful in their work. With a truly human propensity 
they adjust their effort to the requirements and no one may dis- 
cover that they are capable of better things. This is part of the 
reason why we are regaled with stories of what dullards some 
eminent men were in their school days. If Byron and Goldsmith, 
Darwin and Gray were unappreciated by their teachers, we may 
be quite sure it was the fault of the teachers and of their means 
of appraisal. 

The psychologist and the teacher are getting together on this 
question. The psychologist has simplified his methods of testing 
and he is training the teacher to use the simpler instruments. 
On the other hand, school people are realizing with conviction 
that they need to know and to know in terms of the new methods 
of measurement, the physical and mental development of the 
children entrusted to their care. No educational movement 
which goes to make up the modem trend of educational thought 
and practice promises more for the good of the children than does 
the movement which calls for the physical and mental measure- 
ment of school children and the adjustment of school procedure 
in accordance with the facts as revealed by these measurements. 

B. R. B. 
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Ifres -£ X jr?ff -:=:ii:«r cc peccie. F^jZy. ±e es;»r: wio began it may 
gr.-t :- X broa-ier £z«r. iZfi irser i^:erpc«A3cc — ^jji ini e r p r eca aoQ windi lie 
wbo r:=5 =A V na i irc w^^ci dzrcc be ^=soctd cr ^zoenr^hsed br practical 

5o it 3 wrh tbe i^-.«£:f^K:ct leRfz:^ ci scbcci chflirea. Tlus book is 
wrirrec as the preface scx:es ""primarily for :b? $ni5e teadie r .*^ Xoc so 
locg ago the subject was ergay-g nc i::e=::5c:i ocis-ie iX ihe psychological 
laborarorjr and a few issdi«-Jo=s for :ie feecle-ziiiioed. Tbe mnrnmctd par- 
j^jse of the book is '*io fUTiscnrc ihe Urge incrvi\i;LiI dx5ercQC«s in original 
ecilowment which exist azsong schcol chfl^iren asd to show tbe practical 
bearing of these diaerences upoc the everyday problems of dass-room 
managemec: and school adaoinisaatioa.'* 

The Binet-SimoQ Scale, which Dr. Terman has done so xnudi to refine and 
adapt for American use. is the rhir f means of measuring intelligence recog* 
nized in this book. Appropriately, therefore, a brief description of tbe scale 
and of the derivauve measures based upon it is given in tbe beginning. This 
is followed by a general treatment of individual differences and a specific 
statement of their amount and meaning in the kindergarten, in the first and 
fifth grades, and in the first year of the high schooL 

It appears that a large proportion of kindergarten children could do 
sat].%facvjry work in the first grade. But advancement to the first grade 
depends upon chronological age — upon living six years. .\s the author says, 
"the most abrupt break in the curriculum is that from the kindergarten to the 
first grade/' Nowhere^^else^from the first-grade to the university does 
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advancement depend so exclusively upon age. ''The kindergarten alone 
holds aloof, worships at the shrine of a special methodological cult, and treats 
its children as belonging to a different order of himian beings." The need for 
intelligence testing in the kindergarten and of action based on the results is, 
therefore, especisilly evident. 

Two first-grade classes, reported by the author, differed in average 
mental age by more than two years. Yet the teachers of these classes were 
expected to accomplish the same work. The teacher of the poorer class was 
in despair and her efficiency was doubted. But there was nothing ¥n:ong 
with the teacher. Her task was simply impossible. Differences between the 
mental ages of pupils in the same grade are even greater for higher than for 
lower grades. 

As to high-school conditions, children are f otmd to be tmlikdy to graduate 
if their mental ages are less than 0.9 of their chronological ages — ^in other 
words, if their intelligence quotients are below 90. Since ''nearly a third of 
all children test this low or lower," the author declares that "high schools at 
present are in a measure 'dass' schools." 

Mental age is offered as a standard for grading. It is shown that if a 
child's mental age corresponds to the normal age for his grade, he will do 
average work. Incorrect grading is everywhere apparent. The dull child is 
promoted too much and the bright child too little. "The typical bright child, 
though already under age, would generally continue to do satisfactory work 
if promoted one or two grades." 

Dullness is incurable and brightness persists. The intelligence quotient 
(I.Q.) is the measure of these, and it remains substantially constant. Be- 
tween the first and second of 428 pairs of I.Q.'s the correlation coeffident 
was +0.93. Since intelligence practically reaches its maximum at the age of 
16, we may by multiplying 16 by the I.Q. predict with considerable certainty 
what a child's ultimate mental age will be. Evidently, therefore, in the 
intelligence quotient we have a basis of prediction which has great value in 
educational and vocational guidance. It will not tell us what specific studies 
or occupations a child should pursue, but when the minimum intelligence 
required for success in each study or occupation has been learned, it will tell 
us what groups of subjects a pupil may attempt and in what types of work he 
may engage with the probability of success. Within the studies or occupa- 
tions appropriate to a child's mentality choice may be made on the basis of 
inclination or opportunity. 

Children should not be directed into occupations for which they have 
more intelligence than is of use. For many kinds of employment the intd- 
lectual demands are low, yet the rewards are by no means small. Present 
industrial developments are finding a larger and larger use for persons of 
inferior mentality. But in unskilled and semi-skilled occupations, intelligence 
above a certain level is not only unnecessary but harmful. Children, there- 
fore, having such intelligence should be directed towards the higher tjrpes 
of vocations for which they are fitted. A nation's intellectual assets are 
pricdess, and the prindple of conservation will here have its most far-reaching 
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i^iplicatkm — an i^iplicadon in which the teacher occupies the strategic 
position. 

The author takes the attitude that unless the rank and file of teachers 
learn to use intelligence tests, the grading of children according to ability 
"will remain largely a Utopian dream." He advocates the introduction in 
normal schools of a half-year course of three hours per week, or of a summer 
session course, to prepare teachers for Binet testing. He believes, however, 
that teachers in service may learn the Binet procedure, and in the last chapter 
of his book he gives helpful directions as to how this may be done. While the 
supervision of a psychologist or of a person experienced in the use and 
interpretation of the tests is desirable, it is believed that gross errors may be 
avoided without such assistance. The results of the tests will never make 
unnecessary the securing of supplementary data from teachers and parents 
and the use of caution and common sense. Action, especially if based upon 
an assumption of feeble-mindedness or dullness, should not be taken until 
the results have been carefully scrutinized and compared with data as to 
school progress and attendance, illness, physical defects, occupation and 
nationality of parents, and data concerning the probable mentality of other 
members of the family. 

Ordinarily it takes about forty minutes to test a child — somewhat less with 
primary children, somewhat more with the upper grade and high-school 
children. Where time does not permit the use of the entire scale, the author 
suggests abbreviations of it. He also recommends the use of some of the 
recently devised group tests which can be given simultaneously to an inde- 
finitely large number of children. Group tests do not yield as dependable 
results as does the Binet Scale. They should be followed by a more thorough 
examination of children who make exceptional scores. Even the results on 
the Binet test are not to be taken too literally. While errors are relatively 
small, one must remember that the occasional error is just as serious for the 
child concerned as it would be if it occurred more frequently. Care in 
interpreting results, re-testing in the case of unusual findings, comparison 
with the results of educational and physical tests, with teachers' and parents' 
estimates, and with social conditions will prevent mistakes. 

To us the most fascinating chapters of the book are those devoted to the 
special study of a selected number of superior children. Facts, some of which 
are contrary to common belief, are disclosed. The superior child is not 
"queer," nor physically weak. His moral qualities are likely to be superior, 
and his mental development is usually general rather than one-sided. His 
superiority is shown early in life and is permanent. Yet he is usually found 
in a school grade two or three years below where he belongs by virtue of his 
ability. 

The case histories of forty-one superior children are given. They present 
a vivid, concrete picture of what the superior child is like. Too frequently 
they show how utterly these children are misunderstood and tmconsdously 
thwarted by their teachers. 

We know no more inspiring reading for teachers than these chapters on 
superior children. They dispel old notions and throw light upon dark places. 
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The conviction is forced home that such children may actually be in the 
reader's dass, unrecognized opportimities for a type of service which every 
teacher worthy of the name will eagerly seek. 

B. IV. Dm 

Pearl, Norton H. and Brown, H. E. Health by stunts. New York: Mac- 
millan Co., 1919. 216 pp. 

This little book, written by supervisors of physical education in the 
Detroit public schools, who also served as directors of athletic activities in 
the army training camps, and with the A. £. F. in France, will be welcomed, 
not only by supervisors and teachers of physical education, but by parents, 
by boys and girls, and by all who are interested in the building up of an 
American manhood and womanhood soimd in body as well as in mind. The 
volume gives by verbal description and by photographic illustrations direc- 
tions for performing a series of graded exercises, or better, "sttmts" which are 
in effect a series of rough standard tests of physical ability and condition. 
Research men will be interested in finding many illustrations of both perform- 
ance tests in which rate of accuracy are scored directly, and of ability tests 
where scores are determined merely by success or failure. Teachers and 
supervisors of physical education will value highly many suggestions in 
regard to methods of organizing physical education work in the schools, of 
conducting contests, of scoring and tabulating results, and so on, but the chief 
interest to workers in educational measurement is to be sought in the many 
possibilities the book reveab for the construction of standardized tests of 
ph3rsical ability. It is probable that those responsible for physical education 
in our schools will soon feel the pressure for proof of results which the public 
is exerting on every phase of public education. When the time comes for 
surveys and tests, this little book should prove a rich mine of test material. 

For instance, in Detroit, thq contestants to qualify for the Decathlon 
must pass a series of preliminary tests administered under standard condi- 
tions. He must be an eighth-grade boy, without organic weakness. He 
must be able to chin himself six times, do the "set up" sixteen times, the 
"floor dip" ten times, have a grip of at least sixty pounds and a lung capacity 
at least two and six-tenths times his heighth in inches. Why should there not 
be such age-grade standards of physical fitness all along the line? When the 
product of all physical training is checked against suitable objective standards 
it will become much more effective than it has in the past, and the physical 
fitness of the average American will be assured. 

BoBBiTT, Frank M. The curriculum. Boston: Houghton Mifflin Co., 1918. 
295 pp. 

During the last ten years increasing attention has been paid to the 
construction of curriculums in school subjects, particularly in the fields of 
spelling and language; but no systematic treatise has been published during 
that time until the appearance of Professor Bobbitt's book. 
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The book is refreshing in its beauty and simplicity of style. It reads 
easily and speaks directly to the point in dealing with the topics under dis- 
cussion. These are grouped in six sections: ends and processes, training for 
occupational efficiency, education for citizenship, education for physical 
efficiency, education for leisure occupations, and education for social inter- 
communications. 

In the first section the groundwork for treatment of the remaining groups 
is laid. In this section a valuable distinction is made between experience 
gained by imdirected study on the play level and that obtained by directed 
study on the work level Of particular significance is the author's daim that, 
after experience has been gained without direction by children, the curricu- 
lum that follows this "aims at those objectives that are not sufficiently attained 
as a result of the general undirected experience.** Or, to paraphrase, after a 
child has picked up what he will by himself, the school shoidd discover his 
shortcomings and correct those. Thus, for instance, the author says, in 
language, the school curriculum should be based upon the language errors of 
chfldren. In vocational education it should be based upon occupational 
defidendes. 

It is not entirely dear in my mind whether undirected experience is a part 
of the curriculum or not. The author does not discuss the point; but this is 
probably an oversight. Obviously, it is not practicable to let children pick 
up experience everywhere. If a child is turned into a library to browse, it is 
necessary that the books be sdected upon some basis. If he is allowed to run 
at large, the boimdaries must be set in some way: the sawdust of a saloon 
floor ought certainly to be taboo for a growing boy. And, if this ''undirected 
experience" is really selected and, therefore, part of the curriculum, errors and 
shortcomings will hardly constitute an adequate basis for selection. An inter- 
esting argument, at least, could be made on the subject. 

It is tmfortunate that the author does not show the applications of the 
shortcomings concept to the construction of directed curriculiuns in dtizen- 
ship, ph3rsical education, literature, and the foreign languages. But this is 
probably not an omission because the text is a ''first book" and deals largdy 
with the functions of the activities mentioned, rather than with the content 
of the curriculum necessary for the realization of each. 

The book is timely and will be of fundamental value to any student of the 
curriculum. 

w. w. c. 
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1917. 93 pp. 

Beard, Charles A. and Bagley, William C. The history of the American people. New 
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A BIBUOGRAPHY OF STANDARDIZED TESTS FOR THE 

fflGH SCHOOL^ 

Walter S. Monroe, 
Assistant Director^ Bureau of Educational Research, University of Illinois 

In addition to standardized tests designed to measure the abilities of pupils in high- 
school subjects, certain tests designed for use in the elementary school have been given 
to high-school pupils. In assembling this bibliography an elementary school test was 
included if a published report of its use in high school was found. Doubtless other 
elementary school tests have been or could be used with profit in the high school. 

A special effort was made to have the list of tests designed for use in the high 
school include all of which an account had been published. A few tests have been 
included which are in the process of construction. Although it may be that some 
tests escaped notice, this list is more complete than any which has been previously 
published. In a few instances it was difficult to determine whether the methods used 
in constructing a list of questions or exercises were sufficiently scientific to justify its 
inclusion in this bibliography. In general, doubtful tests were included. For this 
reason the reader is cautioned against attaching undue importance to the fact that a 
test appears in this list. Before a test is selected for use, careful consideration should 
be given to both the method of its derivation and the results of its use. When accounts 
of these are lacking, the advice of competent authorities should be sought. 

The list of references for a test includes the account of its derivation, if it has been 
published, and the more important accounts of its use. The brief annotation indicates 
the character of the reference. 

The publisher from which a test can be obtained is given when it could be ascer- 
tained. The Bureau of Educational Research of the University of Illinois carries in 
stock a number of tests which are published elsewhere, and for most of these the Bureau 
has devised class record sheets or other accessories. For this reason the Bureau of 
Educational Research, as well as the original publisher, is g^ven as a source from which 
such tests may be obtained. A few of the tests listed are not available for distribution. 
In these cases the address of the author is given if it is known. All prices are omitted 
because the unstability of the printing industry prevents announcing them perma- 
nently. 

Under the head of "General References" there is given a selected bibliography 
which deals with the general topic of educational measurement. Some of the references 

> This biblioKimphy was preptred with the sssistaDce of Miai Maigwet Doherty, library Atristint 
ID the Boreaa ol Educatkmal Research, Umversity ol niinob. 
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pertain to tests for use in the elementary school, but they will also be found hdpful 
by those interested in the high school field. 

A section is devoted to mental tests. This particular field is developing so rapidly 
at this time that it is impossible to give a complete list of the tests that have been 
devised or that are in the process of derivation. For this reason the reader must regard 
this particular list as tentative and incon^)lete. 

General References 

Ch^nnan, James C. and Rush, Grace P. The sciefUific measuremetU of classroom 

products. New York: SQver, Burdett and Co., 1917. 

For the most part tbis book deals with tests for use in the elementJiry achooL There are three ffeneral 
chapters iHuch will be of intersst to high school teachers. 

Courtis, Stuart A. The Gary public schools: measwremetU of classroom products. 

New York: General Education Board, 1919. 

Besides being a report of the use of a number of standardized tests in the Gary public schoob, includ- 
ing the high schod, thb vtdume is an important contribution to the theory of educational measurements. 
The validity and relialnlity of the tests used in the survey are treated. 

The measurement of educational products. (The Seventeenth Yearbook of the 
National Society for the Study of Education, Part II). Bloomington, Illinois: Public 
School Publishing Company, 1918. 

This wdume off the Yearbook is a compilation by members of the National Association of Directors of 
Educational Research. A complete bibliography b given. 

Monroe, Walter S. "Improvement of instruction through the use of educational 

tests,'' Journal of Educational Research, 1:96-102, February, 1920. 

This article presents a procedure for interpreting class scores and distributions with special reference 
to the Courtis Standard Research Tests, Series B. 

Monroe, Walter S. and De Voss, J. C. and Kelly, F. J. Educational tests and 

measurements. Boston : Houghton Mifflin Co. ,1917. 

This is a general treatise upon educational tests and their use. Chapter vii is devoted to bigh<«chool 
tests. 

Proctor, W. M. "Psychological tests employed in the vocational guidance of 
high school pupils." (To appear in the first volume of the Journal of Educational 
Research.) 

Starch, Daniel. Educational measurements. New York: Macmillan, 1916. 

This book contains two chapters upon school marks. Most of the tests which were in existenre at the 
time the book was written are reproduced. A number of them are de«gned for high school subjects. 

Terman, Le^is M. The intelligence of school children. Boston: Houghton Mifflin 

Co., 1919. 

This book emphasiie^ the need for the use of intelligence tests in the classification and guidance of 
pupils. 

Terman, Lewis M. Measurement of intelligence: an explanation of and a compete 
guide for the use of the Stanford revision and extension of the BinetSimon intelligence 
scale. Boston: Houghton Mifflin Co., 1916. 
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I. CoifMEsaAL Subjects 

Nstioiial Buaiiiess Abllhy Tests 

1. Test on tabulation (mental alertness) 

2. Reproducing instructions 

3. Test on invoicing 

4. Tests on fundamental arithmetic: 

a) Fractions 

b) Percentage 

5. Test in business arithmetic 

6. Tests in English 

a) Spelling, elementary and advanced 

b) Granmiar and punctuation, elementary and advanced 

7. Elementary test in letter writing 

8. Test on answering letters (advanced) 

9. Stenographic tests (transcription and typewriter copying) 

10. Test on copying for the mimeogn^h 

11. Test on addressing envelopes with a pen and on filing 

12. Ayres' Handwriting Scale used to judge handwriting 

The nature of the above tests is indicated in a general way by the titles. For a 
detailed description consult Chapter v of the reference. 

For each of the tests there are ''two series" or two forms. It is intended that the 
first series be used when the test is given for the first time and the second series is to be 
used when it is desired to repeat the test. The two series are intended to be equivalent 
in diffiadty. 

Publisher: National Associated Schools of Scientific Business, Inc., Chicago. 
Reference: Cody, Sherwin. Commercial tests and haw to use them, Yonkers-on-Hud- 

son, New York: World Book Company, 1919. 

Part One ooaUins the fdlowing duptexs: Schools and busineM employment. National Boainess 
Ability Tests, principle off scientific teats, natitmal tests in the classroom. 

Part Two consists of the following chaptexs: Two series of National Business Ability Tests (teats are 
fqxoduced, with directions for giving and scoring), measuring classes and teachers. Appendix is devoted 
to the Ttftoit of use of the tests in classroom. 

Rogers' Stenograpliic Tests. This is the combination of tests which Mr. Rogers found 
to be useful for identifying those persons who possessed the qualities necessary 
for a successful stenographer: 

1. For dictation 

a) Hard Directions 

b) Opposites 

c) Form Substitution 

2. For gnunmar 

a) Hard Directions 

b) Opposites 

c) Mixed Relations 

3. For typewriting 

a) Verb Object 

b) Color Making 
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ieretict: Jaques, M. P. "MmUl tests for typbts and stoiognidKn," /* 
MoJ ilmasemaU, 58:145-46, August, 1919. 

with ths KacBi' SloocniilK TcctB io tbe BnnUjs btut 

n. DOHESnC SCIEMCE 

H»ws« and Triffio^a UamaliaDal mA BeaMnbC Teats in Text3ra and OoA 
"Thew toti have been aHutracted by Leona F. Bowman and Mabel TriUini 
the Unlvdnty oi Chicago and will be dcKnbed in a foithcoming ■aaa&M 
SitppkwieiUary Educationai Utmagrapla published by the School oi Educati 
Univem^ of Chicago." 

Ibrdadi'a Scab fat Mtatanat Catain EleBeota in Hand Sewmg. 

Putluker: Buieau of PublkAtitna, Teacheia' College, Columbia Univets 
New Yoik City. 

WiIEmm a^ Knavp'a Scale for Heaaaii^ SUD in Hachine Sewmg. The methm 
deriving this scale is similai to that used in Thomdike's Handwriting Scale. 

m. DKAwmc 

Utamtt* Sotfeated Scries nl Tests lor Smdyini Talent in Drawing. On the baaii 
e^qierimental testing of nineteen persons who had maricedsbilityiii drawing, lii 
whom were high-sdiool students. Dr. Manuel suggests the following set of diagii 
tic tests: 

1. Tests of theelementatyabili^tarepTeientbylinesiLadBreas,figuresandobJ( 

directly observed. Drawing a hoise (memory) and a toy wagon (object). 

2. Tests of general intelligence (Stanford-Binet reviwin) with special reference 

a) Memory for Digits 

b) Deagns 

c) Sixty Words 

d) Clock Test 

e) Vocabulary 

f) Fables 

g) Code 

h) IndoH^ 

i) Paper Cutting 

j) Logical Memory 

3. Tests of atnlity to (Uscriminate diBerences in visual rnagnitudes (Manuel's 1 

in Discrimination of Visual Proportions, Manuel's Series). 

4. Teats of visual acuity and normality of color vidon. 

5. Tests of ability to observe visually: 

a) Whipple Cancellation Teats — 1 forms 

b) Rossolimo OiMcrvation Test 

c) Whipple Description of a Stamp 

d) McDougall Spot Pattern 

6. Tests of memory for visual forms especially deferred memory: 

a) Rossolimo Recognition of Lineal Figures 
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b) Rossolimo Recognition of Colored Figures 

c) Rossolimo Recognition of Pictures 

7. Tests of ability to manipulate spatial forms. 

a) Thurstone's Hand Test 

b) Thurstone's Spatial Relations Test 

c) Punched Holes 

d) Rugg's Painted Cube Test 

8. Tests of esthetic judgment: 

a) Thomdike's Tests of Esthetic Appreciation 

b) University of Illinois — Esthetic Judgment Test. 

Reference: Manud, H. T. Talent in drawing: an experimental study of the use 
use of tests to discover special ability. (School and Home Education Mono- 
graphs No. 3). Bloomington, Illinois: Public School Publishing Company, 
1919. 
TUa monograph b devoted to a deaoiptioa of the tests and an analysb of the results obtained. 

Riigg's Scale lor Measuring Freehand Lettering for Use in Secondary Schools and 
CoOeges. It consists of a series of eight samples of freehand lettering, arranged in 
the order of increasing merit. It may be used in measuring the efficiency of a 
student's work in freehand lettering. 

Reference: Rugg, H. O. "A scale for measuring freehand lettering," Journal of 
Educational Psychology, 6:25-42, January, 1915. 
Derivation, function, and experience with the scale is discussed. 
(To he continued in the March Number,) 




The George Peabody Foundation has recently sponsored a movement 
that is full of promise for the future cultural and educational relations of 

America with foreign nations. This is no less than the 
latematioiial effective organization of all correspondence between 

Edncatioiuil pupils studying modem foreign languages in American 

Correspondence schools and those similarly engaged in the schools of 

France, of Spain and South America, and of such other 
lands as shall eventually be included. Hitherto such letter exchange, while 
of great value in individual instances, has been ephemeral, spasmodic, and 
disorganized. It has not realized its full potentialities. The Peabody 
Foundation has set aside one of its buildings on the campus of the Peabody 
College for Teachers at Nashville as the national American office and has 
appointed Dr. Alfred I. Roehm as national director. With the cooperation 
of state and conmiunity chairmen all over the cotmtry the work of inter- 
national educational correspondence is rapidly being organized. 

The first branch established was the French-American Bureau. In 
France Monsieur Charles Gamier of the French Ministry of Education has 
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charge of the central French office in Paris. Lists of pupils in French and 
Belgian schools, who have been selected as especially fitted to inaugurate 
the correspondence, are sent to the American office at Nashville where the 
details of exchange with American schools are arranged. A similar Bureau to 
cover correspondence with Spanish-^)eaking lands has been authorized by 
the United States Department of State, and this will be organized imme- 
diately. Other bureaus to include other foreign languages will follow in due 
course. 

The plans of the Peabody Foundation have received worldwide approval. 
The possibilities of liberalizing influences and contacts are without limit. 
To quote from Mr. Clazton's article in School Life for September 15, 1919: 
"Linguistic training will not be the only educational end served. Along 
with the letters there will be a fine exchange of historical, artistic, geographi- 
cal, manufactural, commercial, and home-life material and information, 
clippings, picture postals, kodak views, etc., leading up to the deepest 
exchanges of human sympathies and ideals that will reinforce international 
good-will." In addition to the above article of the Commissioner of Educa- 
tion the reader is referred for details to a description of the purposes and 
plans of the Foimdation in The Modern Language Journal for November, 
1919, pages 73-76 by the present writer. Another shorter article of interest 
may be found in School and Society for September 27, 1919, page 377. It is 
manifest that pupils cannot at once write letters of very great value in the 
foreign language. Therefore it is suggested that the initial letters be in the 
pupil's own tongue. Thus each school will gradually have a number of model 
letters in the foreign idiom. Careful study of these models will be far more 
stimulating than the usual arid exercise of the average composition manual. 
The pleasure of actuality is here of great value. This has been the universal 
experience of teachers who have tried letter exchange in lieu of set composi- 
tion. In due course the pupil will substitute the foreign tongue for his own. 
Each letter received is a challenge to send in return an equally good, or a 
better, answer. It is of course deemed wise that boys shall correspond with 
boys, and girls with girls, since mutual interests are thereby better utiUzed. 
While the burden upon the teacher will doubtless be somewhat greater at 
first than under the usual conditions of composition work, yet the same 
stimulus exists for teacher as well as pupil. It is even quite conceivable that 
the net result may prove a lessening of the teacher's task rather than an 
increase, since pupils invariably do better that which they like to do. At 
present no composition manual based upon epistolary style exists, but such 
books will soon appear in response to an evident demand, and they can 
greatly help in this important work. 

It is the aim of the Peabody Foundation to establish this enterprise upon 
a self-supporting basis as soon as possible. Therefore communities and 
schools are asked to contribute to a permanent endowment fund in one of two 
ways. By the first or ''quota method" each community will pay two dollars 
for each one thousand inhabitants. This single payment will entitle all 
persons in the community to all services of the Foundation forever. By the 
second or ''fee method" every pupil enrolled for international correspon- 
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dence will pay an annual fee of ten cents. Already there have been enroll- 
ments under both these methods from every state in the Union, and the 
interest is rapidly spreading. Until this permanent endowment has been 
secured, the Peabody Foundation will bear the expense of the enterprise. 
Later it will be the trustee of the endowment and will render annual reports 
to the United States Bureau of Education. 

The liberalizing effects of such a system of international correspondence 
are certainly beyond all doubt. All friends of education see in this plan very 
great possibilities of good and will be eager to contribute to its success. 

Thomas E. Oliver 
SkUe Chairman far Illinois. 

The tenth annual conference of specialists in industrial 
Msnnai Arts education engaged in training teachers in industrial and 

Conference, manual arts in institutions ocated in the Mississippi Valley 

UniTeruty of was held at the University of Cincinnati, December fourth, 

Cinctnnsti &fth and sixth, 1919. About forty-five men representing 

approximately as many institutions were in attendance. 

These conferences are called from year to year by the United States 
Commissioner of Education at the request of the group, there being no 
permanent organization. For the past ten years Dr. William T. Bawden, 
Assistant to the Commissioner, has acted for the Commissioner in the matter 
arranging time, place, and program. 

The following papers were presented at the Cincinnati meeting. The 
program was planned to allow generous time for discussion by the group. 
In fact the meeting is looked upon primarily as an opportunity for the ex- 
change of views by those present. 

''An experiment in developing a course in foreman training" by Charles 
R. Allen, Agent for Industrial Education, Federal Board for Vocational 
Education, Washington, D. C. 

''Progress in the development of plans for preparing teachers of industrial 
subjects" by Professor James McKLinney, Director of the Chicago Center of 
Teacher Training Department of Industrial Education. 

"The itinerant teacher of subjects in village and rural schools" by 
Professor C. S. Van Deusen, State Normal School, Kent, Ohio. 

"Provision for the training of vocational teachers in the army" by 
Professor R. W. Selvidge, Educational Adviser, War Plans Division, War 
Department, Washington, D. C. 

"Opportunities for service in the field of occupational therapy" by Lieu- 
tenant Colonel Mattock. 

"Training teachers of vocational and industrial work not federally aided" 
by Professor C. A. Bowman, Stout Institute, and W. E. Roberts, Cleveland, 
Ohio. 

The program of the meeting also included a report of the committee on 
practice teaching which was concerned with plans. One of the best of these 
was submitted by Professor A. F. Siepert, Bradley Institute, Peoria. 
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At the annual meeting of the Association of 
A Quuce to Test County Superintendents of the State of Illinois held 
the Rural Schools at Springfield on December 29 a committee of five was 

appointed to facilitate cooperation with the Bureau of 
Educational Research at the University of Illinois. This committee is 
composed of the following members: 

G. O. Smith (Chairman), Bureau County, Princeton 

Mrs. Lois Coombes, Moultrie County, Sullivan 

F. E. Crawford, Fayette Coimty, Vandalia 

Charles H. Watts, Champaign County, Urbana 

J. W. McKinney, Williamson County, Marion. 

The immediate objective of this committee is to increase the use of 
standardized tests in the rural schools. Already some superintendents have 
given one or more standardized tests in all the schools of their county but 
it is the feeling of the coimty superintendents as expressed through their 
state association that the use of standardized tests should become general 
throughout the state. 

• •••••• 

The difficulty of reaching individual rural schools from one center such 
as the state Bureau of Educational Research is at once apparent. However, 
the relative isolation of the rural teacher creates a situation in which a 
standardized test can be even more helpful than to a teacher in a dty school 
system who is working tmder close supervision. It will give her definite 
objectives for the pupils of each grade and, since in many cases she has a 
small number of pupils, it will be possible for her to make a relatively com- 
plete diagpiosis of the shortcomings of her pupils. If these valuable instru- 
ments for measuring instruction are to become generally used in rural 
schools, it is incumbent upon coimty superintendents to be active in bringing 
them to the attention of rural teachers. 

The action of the county superintendents of Illinois represents a pro- 
gressive movement. In many states particular county superintendents 
have been using standardized tests in their schools for some years, but this is 
thought to be the first instance of concerted action by all of the county 
superintendents of a state. 

Commissioner P. P. Claxton of the United States 
The Federal Bureau of Education called a meeting of representatives 

Bureau and from a number of the larger state universities at the 

Educational Hotel Statler, St. Louis, Missouri, January 2 and 3, 1920. 

Research This meeting was attended by the following representa- 

tives: 
University of California: R. S. French 
University of Illinois: B. R. Buckingham and Walter S. 

Monroe 
University of Elansas: F. J. Kelly 
University of Michigan: Guy M. Whipple 
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University of North Carolina: L. A. Williams 
University of Pennsylvania: J. H. Minnick 
University of Texas: C. T. Gray 
In addition to Commissioner Claxton his assistant Wm. T. Bawden was 
in attendance. 

Recently, upon the invitation of the Commissioner of Education, 
research stations have been established at a number of universities. In 
addition to the institutions represented at the meeting, the following appoint- 
ments have been made: University of Iowa, University of Minnesota, 
University of Virginia, and University of Washington. 

In a circular issued September 15, the purpose of the plan of establishing 
research stations was stated as follows: 

(1) To promote scientific research in education, and to make the results of such 
research available to students of education. 

(2) To utilize in a national way such special resources and facilities as may be 
placed at the disposal of the Bureau of Education by the cooperating institutions. 

(3) To coordinate and stimulate the educational forces available in the cooperating 
institutions. 

(4) To bring the Bureau of Education into closer relations with the educational 
agencies of the country, and thereby to promote the Bureau's imderstanding of educa- 
tional needs and problems, and to extend its range of effective service. 

This move upon the part of the Bureau of Education is significant. It 
means first a closer identification of the Bureau with the schools of education 
in the larger state imiversities. It also means that the United States Bureau 
of Education is identifying itself with the rapidly developing recognition of 
and provisions for educational research. Within a period of little more than 
five years there has developed a new type of department in the field of educa- 
tion, namely a department which has for its particular function the stimulat- 
ing and directing of educational research. The larger portion of this research 
is carried on in cooperation with public schools. The recognition of thb 
development by the United States Bureau of Education is particularly 
significant at this time when an effort is being made to secure a larger recogni- 
tion for education throughout the country. 

From the standpoint of the Bureau of Education, this move will mean 
that it will assume a larger place in the educational activities of the country. 
It is a lamentable fact, but nevertheless true, that the recognition given to 
education by the government is far less than that accorded to this field by 
most governments. If the establishment of research stations of the Bureau 
does no more than increase the prestige of the United States Bureau of 
Education, the project will be justified. 
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seating capacity of forty. Adjoining this room there will be a private dining 
room where limcheon and dinner will be served to the members. The use 
of the committee room is given to the association gratis; but the members 
will be expected to eat luncheon and dinner in the dining room assigned to 
the Association. They would anyway! 

At this meeting a preliminary report of the committee on standards will 
be rendered. The report will be open for discussion. The closed meeting will 
also afford an opportunity for an informal discussion of business matters. 
This will enable us to dispose of them quickly at the business meeting Thurs- 
day evening. If any member has an item of business which he desires to have 
debated he may bring it up at the closed meeting. 



The following papers are announced for the public meeting to be held 

Thursday morning and afternoon, February 26: 

W. W. Theisen. "Provision for individual differences in the teaching 

of reading." 

H. A. Brown. "Formulation of method in reading in the light of recent 

investigations." 

William S. Gray. "Significant tendencies in the diagnosis of reading 

accomplishment. " 

Edward L. Thorndike. "Intelligence tests for college entrants." 

F. J. Kelly. "Results of three methods of teaching the fundamentab 

of arithmetic, measured by the Courtis Tests." 

Cecile White Flemming. "Reading ability and intelligence." 

S. A. Courtis. "Report of committee on standards." 

Leonard P. Ayres. "The comparative effectiveness of state school 

systems." 

Arthur W. Kallom. "Reproduction as a measure of reading ability." 
J. W. Richardson. "The campaign method in elementary education." 
As will be noticed, the program is largely grouped around the ideas 

of reading and intelligence testing. 

The annual dinner will take place on Thursday evening at 6:30 o'clock 

at the Hotel Statler. Price per plate $3 . 00. 
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A PROPOSED INDEX OF EFFICIENCY IN TEACHING 

UNITED STATES HISTORY 

B. R. Buckingham 
University of lUitwis 

When a supervisor enters a classroom to inspect the work and 
rate of the teacher, he carries with him a set of more or less 
variable personal standards. He may also fortify himself with a 
schedule of qualities on the basis of which he will perhaps believe 
that he is scientifically evaluating the work of the teacher. We 
have a number of score cards which set up such captions as 
personality, voice, neatness, method, control, and the like. 
These are by no means satisfactory. Teachers possessing these 
qualities to a high degree may nevertheless be poor teachers. 
Persor ility as a producing agency, neatness functioning, voice 
us*.^*'^ get results, method which does the business, and control 
whi-ii acilitates work — these qualities, in other words, not as 
posse* ms of the teacher but as productive of changes in pupils — 
are to.. ^hs tones of good teaching. 

Wf Jiust, therefore, seek for teaching efficiency in the changes 
produ^ J in children rather than in the qualities possessed by 
teachers. We are not, however, to suppose that we have greatly 
simplifi' d our problem when we have thus defined it. The results 
of teac*' ing are numerous and far reaching. We can never hope 
to me^. ire all of them, for they multiply to the end of life. 

Yc' ve are not without means of measuring with a considerable 
degree accuracy the efficiency of teaching. What we need to 
do is tnd some one major result the simplicity of which makes 
its a^'i cliension relatively easy and the relationship of which to 
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with principles, or with each other; the classification of men or 
events in various accepted ways — these are some of the types of 
exercises now being used. As to the form which answers may 
take, there is also an increasing richness and variety. One of the 
earlier devices was to print a question in a box and require the 
answer to be written in it. Numbers are used to indicate facts, 
particularly facts regarding the sequence or importance of events. 
Instead of requiring the pupil to write out the names of men, 
events, measures, policies, etc., a number of these are printed and 
check marks are required. The true-false t3T)e of test has been 
introduced.^ It consists of a series of statements, some of which 
are true and some of which are false and the pupil is required to 
indicate the truth or falsity of each statement. The completion 
type of test has been with us a long time and has proved exceed- 
ingly useful. 

But in order to be certain that responses to questions are 
either right or wrong, the questions must, clearly, be questions of 
fact. One may admit the ease with which such questions may be 
rated and the cleverness of authors in arranging fact tests and yet 
remain in doubt as to the value of the results of such tests as 
measures of ability in history or of the eflBdency of the teaching 
of history. The problem then resolves itself into this: granted 
that fact questions are easy to devise and easy to rate, what 
meaning can we give to the results? The critics of measurement 
have all along been sajdng that the measurers were formalizing 
education, that only the least valuable subjects or parts of sub- 
jects could be measured, in short, that the only appeal was to 
the memory or to a few simple skills such as those involved in 
handwritmg. 

There are those who seem to think that memory was given 
us as a human attribute only to be despised. In the vocabulary 
of the modem pedagogical writer, the word memory is only used 
in a deprecatory sense. In my own judgment, the case against 
memory has been vastly overstated. This opinion, however, 
will not be urged in this connection. But it will be apparent as 
we proceed that, even when we think we are appealing to a sup- 
posedly higher process, we may really be dealing only with a 
somewhat higher form of memory. 

^ McCall, W. A. "A new kind of school ^examination/' Journal cf Educational 
Research, 1 .33-46, January, 1920. 
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Fact questions are those questions whose correct answers are 
facts. Observe, that the determination of whether a question is 
a fact question or not depends upon the character of the answer 
which is accepted as satisfactory. We may ask a child what he 
thinks were the results of the War of 1812; but if we only credit 
him with a satisfactory answer when he tells the actual results of 
the war, we are dealing with a fact question, no matter how we 
delude him or ourselves with the notion that he is fancy-free, 
because we have asked him what he thinks. A fact question 
appeals to the memory. It may be a date or a name, an incident 
or an event, a policy or a movement, a cause or an effect, an 
evaluation or a relationship. It may be bald and meaningless 
or it may be significant, and even surcharged with emotion. 

It appears, therefore, that these fact questions — however 
rich they may be in meaning — are nevertheless capable of being 
objectively rated and easily scored. 

If, therefore, it can be established that test scores on fact 
questions are directly related to the thing we call historical ability, 
we shall be justified in measuring historical ability by means of 
-the ability to answer fact questions. This relationship may be 
mathematically established if we can secure from the same group 
of pupils two sets of measures: (1) scores on fact questions and 
(2) scores in historical ability. I am not sure that I know what 
historical ability is. Doubtless, psychologically speaking, there 
is no such thing as historical ability but only many different 
historical abilities; in other words, the ability is probably plural 
rather than singular. I presume, however, that we shall come 
somewhere near the conception of historical ability if we secure 
measures of ability to think correctly and to judge characters 
correctly in the field of history. At least in the most elaborate 
and carefully analyzed history test, namely that of Van Wagenen,' 
the assumption appears to be made that historical ability is rather 
fully covered when we have taken into account information, 
thought, and character judgment. 

' Van Wagenen, M. J. Historical informaUan and judgment in pupils of elementary 
schools. New York: Teachers College, Coliunbia University, 1919. 

Van Wagenen, M. J. American History Scales (Information Scale, Series A and B ; 
Thought Scale, Series A and B; and Character Judgment Scale, Series A, B, and L). 
Published by Teachers College, Columbia, University, New York, 1919. 
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judgment scores the correlations were +0.4S and +0.43 re- 
spectively. 

As between fact and thought scores, the relation, therefore, 
seems to be very close. My high-school results are not as high 
as Van Wagenen's seventh and eighth grade results because the 
thought test (a test which Van Wagenen used in grades as low 
as the fourth) proved to be too easy to distinguish thought 
ability among the more capable children. But if in grades for 
which these fact and thought questions are appropriate the 
correlation is +0.80, we are justified in saying that the two tests 
tell much the same story — in other words, that, after having given 
the Van Wagenen information test, we shall gain little by giving 
his thought test. 

Nothing, therefore, either in Van Wagenen's testing or mine 
justifies one in attempting to measure all the desirable outcomes 
of history teaching. Fact scores seem to be surprisingly suflSdent. 
Moreover, thought and character judgment are hard to rate; 
and one rater cannot be altogether consistent either with another 
or with himself at another time. Accordingly, any added con- 
tribution which the testing of such abilities may make to our 
estimate of "general ability" in history will not only be small but 
will be measured with uncertainty. 

To be sure, thought and character judgment do not represent 
all the desirable outcomes of history teaching. We wish our 
pupils to grasp the meaning and significance of historical situa- 
tions, to apprehend changing standards of life, to judge the 
reliability of historical material or evidence, to distinguish be- 
tween statements of fact and statements of opinion. This list 
of aims is taken almost verbatim from Van Wagenen; and doubt- 
less it could be extended. But as to these, may they not all be 
shown to rest upon a knowledge of facts? How may one "grasp 
the meaning and significance of historical situations" unless one 
has at hand the facts about the situations and the additional 
facts which will give them "meaning and significance"? How 
may one "apprehend the changing standards of life" unless one 
knows what the standards were before and after the changes 
took place? How may one "judge the reliability of historical 
material or evidence" unless one knows the material and the 
evidence in question and the facts or criteria on which their 
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reliability depends? Finally, how may one ''distinguish between 
statements of fact and statements of opinion" — except so far as 
the form of the statement itself furnishes the distinction — without 
knowing the facts in the case? 

These queries, lead to the statement that a knowledge of 
facts — information, as Van Wagenen calls it — ^is s>Tnptomatic of 
higher abilities in history. The e\'idence supporting this view 
arises not only from the fact, as shown above, that pupils who 
know facts will also think and judge well but also from two 
further conditions. First, we may extend the term "facts" to 
include exact information of any nature in the field of history — 
information not only as to dates, persons, and places but also as 
to causation, relationship, political and social movements, eco- 
nomic developments, religious beliefs, wars and rumors of wars, 
peace and the arts of peace. Second, knowledge of facts condi- 
tions higher abilities because many items usually included under 
these higher abilities are in reality essentially factual. Since 
Van Wagenen is the first test maker to present a thoroughly 
worked out scheme of items other than those of information, we 
may profitably consider some of them. I shall examine the first 
four questions of his Thought Scale, Series A, together with his 
acceptable answers to those questions. 

The first reads as follows: "Before the steamboats were made 
people used to travel on the ocean in sail boats. Steamboats 
were not made until a long, long time after the European people 
came to make their homes in America. How do you think these 
early European settlers came to America?" The acceptable 
answer is "in sail boats" and it is a fact. Therefore the question 
is a fact question although introduced by the words, "How do 
you think." 

The second thought question reads: "A little before the year 
ISOO the people of Europe were anxious to find a new way to get 
to India. Some people thought that India might be reached 
by sailing westward across the Atlantic Ocean. Columbus was 
one of these people. It was at this time that Columbus found 
America. What do you think Columbus was looking for when 
he found America?" Full credit is allowed for any of the follow- 
ing responses: "A short route to India;" "India;" "Western 
passage to India;" "Western route to India;" "Northwest passage 
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to India;" "New way to India;" "A way to India;" "An easy 
way to India." Here again the answers accepted are facts, and 
the question is, therefore, a simple fact question! The child is 
asked what he thinks Columbus was looking for, but evidently 
no thinking is expected. 

The third question on the Thought Scale reads: "A hundred 
years ago it took a letter several days to go from New York to 
Boston. Today it takes only a few hours. Why do you think 
it took letters so much longer to go to Boston 100 years ago than 
it does today?" These answers are allowed full credit: "A hun- 
dred years ago there were no railroads;" "no trains or steamships;" 
"travel by stage coach or horses." Upon what, then, does the 
ability to answer the question correctly depend? Does it not 
clearly depend upon a knowledge of facts? 

Question four: "The Northmen probably came to America 
as early as the year 1000, nearly 500 years before Columbus and 
the Cabots sailed from Europe. There is no record of any one 
else having come to America before the year 1000. By whom 
do you think America was first discovered?" Acceptable answers 
are: "The Northmen," "Vikings," and "Lief Ericcson." If we 
ask what enables a child to answer "Vikings" or "Lief Ericcson" 
are we not obliged to say that it is a knowledge of facts? The 
thought element in all these questions is only in the form — a form 
which employs the word "think." 

Not all of the questions on the Van Wagenen Thought Test 
are so obviously factual, but most of them are; and some of those 
which are not, call for thinking which has no necessary reference 
to history. 

I shall not examine in detail the questions in character judg- 
ment. Each consists first of a narrative and then of a requirement 
to underline three of ten adjectives which best describe some 
character or group of characters in the narrative. Reading and 
language ability are necessary and almost sufficient for success. 
Facts play no part except as they are given in the narratives; 
and no other products of instruction in history appear to be 
required. 

Whatever, therefore, may be the desirable outcomes of the 
teaching of history, it does not appear to be necessary that a 
valid test should require reactions with reference to all of them. 
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It may merdy require reactions which are symptomatic of them. 
In other words, we may distinguish between the content 
and method of teaching on the one hand, and the content and 
method of testing on the other. Many do not believe this; they 
regard tests as teaching devices, or at least as encouraging certain 
types of teaching. This is not always true, and may never be 
true in a content subject such as history. A test, to be a valid 
measuring instrument, must provide a reliable quantitative state- 
ment which varies in direct proportion to the ability or abilities 
which we seek to measure. It may be one of the complex of 
abilities. It may — theoretically at least — be something which 
is not a historical ability at all just as the expansion of a liquid in 
a colimm is not temperature. If it is supposed that by setting 
up fact tests we encourage formal fact teaching, this supp>osition 
may itself be in error. The fact test can be as meaningful as we 
desire to make it. As I have pointed out, our facts may far 
transcend those of dates, persons, and places. Again, it will be 
found that the mere teaching of formal facts will do little to enable 
a child to pass a well-constructed fact test in history because 
the right kind of facts are not learned by a dead lift of the memory 
but by discussion and reflection, by collateral reading and self- 
expression. 

If, after giving a fact test, we should desire to know how 
capable the pupils probably would be in other ways, we may infer 
this with substantial accuracy without giving any other test. Sup- 
pose, for example, that an instructor has given the Van Wagenen 
information test and wishes to infer the compK)site ability of the 
pupils to think and to judge character. The teacher may do this 
provided the relationship has been established between scores in 
the information test and the combined scores in the thought and 
character judgment tests. The correlation coefficient expresses 
a relationship but not in usable form for this purpose. As a 
result of the testing carried on in the high schools at Champaign 
and Danville, we derived an equation by which the required 
inference may be made. This equation was y = 72,S+0.9x,^ 
A number of applications of this equation were made and most of 
them yielded results in close conformity with the actual test 

* Such an equation is called a regression equation. In this case, x stands for the 
fact scores and y for the combined scores in thought and character judgment. 
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results. The first pupil in our alphabetical arrangement had a 
score in the information test of ii. Substituting this for x in 
the equation we find that y = 103.5. This then is the inferred 
score in thought and character judgment combined. The real 
score was exactly 100. 

The prophesy, however, does not always work as well as this. 
The second pupil in the alphabetical arrangement scored 36 on 
the information test. When this value is substituted for x in 
the equation, it yields a theoretical score of 105.2. The real 
score was 114. Thus the prophesy is 8.8 units less than the 
actuality. 

It will be interesting to have a general expression for the 
accuracy that a teacher may expect from the use of this equation. 
The equation only purports to give the score that on the average 
would be obtained by giving the thought and character judgment 
tests a large number of times. In any individual instance the 
chances are found to be even that the score obtained from the 
equation will differ from the score obtained by actual testing by 
not more than eight units. Since there are 144 units in the 
combined thought and character judgment tests, the chances 
are one to one (or we may say an even bet) that the score obtained 
from the equation will be within about 5 percent of the true result. 

Thus we have given data and inferences to support the possi- 
bility of indirect measurement in history. The doctrine of 
indirect measurement requires us to find a magnitude which is 
easy to measure and which also varies closely with the more com- 
plex magnitude which we wish to measure but to which it is 
difficult to apply our instruments. It is maintained that fact 
questions — when the term fact is given its full and proper mean- 
ing — afford an easy means of measurement because of the unequiv- 
ocal character of the responses and that these responses vary 
reasonably closely with what we are thus far able to set up as 
higher abilities in history. We have pointed out that the most 
notable attempt to measure two of these higher abilities has not 
succeeded in getting far away from a fact basis. It is ako urged 
that a distinction be made between methods of teaching and 
methods of test making; and that if the type of testing which we 
adopt is thoroughly significant in the sense that it varies with 
the higher abilities, we shall be encouraging the training of these 
higher abilities when we use it. 



THE SELF-SURVEY IN THE ELEMENTARY SCHOOL: 
AN EXPERIMENT IN COOPERATION 

R. H. Lane 

Assistant Superintendent of Schools, Los Angeles, Calif omia 

The following notice appeared in the Los Angeles, California 
School Journal for January 20, 1919: 

The Division of Educational Research has in mind for the near future 
the development of a plan for the Self-Survey of the Elementary School by 
the Principal and his Associate teachers. This will be accomplished partly 
by means of standard and other tests, partly by an investigation along uni- 
form lines into several phases of the administration and organization of the 
school. It is a matter of great gratification to the members of this Division 
that the courses along this line at the State Normal School, have been so well 
attended, showing that the time is ripe for an enterprise of this kind. 

It must be obvious that such a scheme can be successfuUy worked out 
only through the cooperation of those principals who wish to undertake the 
work. All principals who are interested are asked to communicate at once 
with the Director, stating that they will be willing to take the time during 
the spring term to give certain tests and undertake certain studies into the 
organization and administration of their schoob. This will necessitate a 
few meetings in the near future, but every effort will be made to avoid taking 
an undue amount of the principals' time. It is suggested that not more 
than twenty principals form the first group to undertake this work. 

In spite of the restriction placed upon the number of members, 
the class which began work in February was made up of twenty- 
eight elementary school principals, representing all types of 
schools from the large well-graded city school in the metropolitan 
district to the small imgraded rural school. As a check upon 
the accuracy of the methods employed by members of the class, 
the director carried on the work outlined for members of the 
class simultaneously in five other elementary schools, whose 
principals and teachers contributed largely to tJie success of this 
enterprise by their hearty cooperation. 

The members of the class were given, in addition to the pre- 
liminary instructions for giving the first tests, some general 
advice as to the spirit in which the enterprise was to be carried 
out, in something like the following vein: 

172 



March, 1920 INDEX IN TEACHING fflSTORY 163 

ment. Yet everyone knows that to measure the spelling ability 
of pupils is one of the first steps of the novice in measurement. 
Similarly, nobody thought that ability in reading could be mea- 
sured, yet the sale of millions of copies of reading tests now assures 
us that its measurement is at least being widely attempted, and 
that people believe they are securing reasonably reliable results. 

In the case of United States history, there is evidently a phase 
of the subject which lends itself admirably to measurement. The 
method of expressing the difficulty of the elements in any test 
has been carefully worked out. It has, therefore, become per- 
fectly feasible to apply this method to any subject, the difficulty 
of whose elements can be determined. One definition of diffi- 
culty — not the only one, to be sure, but one which is especially 
significant — is the proportion of correct responses to the task in 
question. When did Columbus discover America? Who was 
president of the Southern Confederacy? What two probable 
European ventures was the Monroe Doctrine set forth to fore- 
stall? These are matters whose difficulty on the basis of the pro- 
portion of correct responses may be as accurately determined as 
the difficulty of the number combinations or of the spelling of 
words. 

"Arrange the following events in the order in which they 
occurred" says one author of a history test. Since there is but 
one order of occurrence and that order is a matter of record about 
which there can be no dispute, this question is likewise one whose 
difficulty can easily be determined. Adopting one of the devices 
of the Army Test whereby a number of ends of sentences are 
given with instructions to the subject to underscore the right one, 
another author gives questions of this type: "The Huguenots 
first settled in Baltimarey Boston y Charleston , New York, Phila- 
delphia.^^ . Or again, "The Patroons were Dutch fishermen, fur- 
traderSy land owners, miners, preachers, teachersJ^ Again there is 
only one correct response and its correctness is not questioned by 
qualified persons. Many other types of questions might be 
listed — questions the responses to which are either undoubtedly 
right or undoubtedly wrong. Asking the names of men to be 
connected with events; requiring the selection, from a given list, 
of the policies or events favored by a given party; the association 
of events with dates, of causes with effects, of men with policies, 
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An effort was made to keep constantly before the class the need 
for intelligent interpretation of the results in each test. It may 
be safely laid down as a general rule that any test which does not 
lead to definite improvement in the progress of pupils is a test 
which is not worth giving. It is true that having found the 
"average" or central tendency of a class in some performance the 
principal is possessed of information which justifies him in saying 
that a particular class in a particular performance reached, ex- 
ceeded, or fell below the accepted standard in such case made and 
provided, but the classroom teacher will not derive much help 
thereby. In any test four steps should be recognized: (1) The 
test gives us the facts in the case; (2) It shows which pupils are 
failing in that phase of instruction covered by the test. Hence if 
the test is to function: (3) The reason for those individual failures 
must be found; (4) Remedial measures must be taken to correct 
those failures. 

For a full treatment of this subject of interpretation see 
Dr. Monroe's Measuring the Results of Teaching.^ In addition, 
the results from experiments in the control schools along this line 
will be found illuminating. 

One of the fifth-grade classes tested early in March, attained 
a median in the Quick Test in Arithmetic* of 2.5 problems correct 
in six minutes, an obviously unsatisfactory result. The common 
prescription of the classroom teacher in such cases is "more 
drill," but it was pointed out that more drill would be ineffective 
unless the cause for each individual failure was located. This 
was done and the following instances of failure noted. 

1. In addition several children knew single combinations per- 
fectly, i.e., 6 plus 7, but failed on similar combinations when 
extended into decades, i.e., 36 plus 7, 47 plus 6, etc. 

2. In addition of four columns children had not been taught 
to place the "carrjdng figure" above or below successive columns, 
hence if their attention wavered slightly, the carrying figure was 
forgotten and the addition had to be gone over from the beginning. 

3. In long division many children did not know how to find 
the first figure of the quotient. 

* Monroe, Walter S. Measuring the results of teaching. Boston: Houghton 
Mifflin Co., 1918. 

' Second year hook of the Division of Educational Researchy Los Angeles , California , 
1919 (Los Angeles City School District No. 21) p. 3. 
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4. In the following problem a girl worked as follows: 

4 

36)16236 
144 

She then asked the observer if one added or subtracted 144 
to or from 162! 

By means of diagnosis of this kind and very intelligent "follow 
up" work by the teacher, the class in June attained a median of 
5.2 problems correct, an improvement of over 100 percent. 

In another control school several children were located who 
were very poor in oral reading with respect both to speed and 
accuracy. Careful records were made of these children by means 
of Gray's Oral Reading Test (Standardized Paragraphs) and 
individual attention was paid to each child by his teacher with 
a view to eliminating sources of difficulty. At that time, the 
writer made the foUowing recommendations to the teachers. 

TO THE TEACHER 

I present herewith an accurate record of the scores of those children who 
had unusual difficulty in their oral reading tests. Let us repeat the test in 
June to note improvement. Failure in oral reading is due to one or all of 
the following causes: (a) Deficient vocabulary, i.e., lack of a sufficiently large 
number of words which the pupil is able to recognize at sight; (b) lack 
of phonic power to analyze imfamiliar words; (c) lack of ability to move the 
eye along swiftly enough to catch the text in large units or phrases — "eye 
sweep"; (d) faulty or slovenly enunciation; (e) imfamiliarity in the middle 
grades with the derivation of words, i.e., word analysis^ (f) lack of adequate 
material for rapid oral reading, i.e., easy supplementary readers. 

I therefore recommend exercises as follows: 

(a) Vocabulary drills to enlarge the vocabulary of sight words. 

(b) Phonic drUls to give power over unfamiliar words (see Gordon and 
Beacon Manuals). 

(c) Word analysis drills (see Horace Mann Readers). 

(d) Frequent time exercises in oral reading to cultivate rapidity. 

(e) Enunciation drills. 

A repetition of the test in June showed marked improvement. 

A word of caution must be given to the principal who gives a 
test and finds the result below standard. The obvious explanation 
is that the teacher of the class is a poor teacher, but one soon 
learns to distrust this easy and obvious explanation. In one of 
the control schools several primary classes failed in a simple read- 
ing test. The personnel of the teaching force was of so high a 
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character that the factor of poor teaching was quiddy <>liiTiinati»H 
from the situation. After a careful investigation by the principal 
the following reasons for the failure were found: 

1 . The pupils in the failing classes had been N-ictims of half-<[ay 
sessions for several terms. 

2. The pupils had had a succession of teachers in the preceding 
terms, one class alone ha\ing had seven different teachers in the 
ten months of school. 

3. There had been several classes in each room at a time, 
i.e., B2, A2, B3, A3, with the result that in the effort to care for 
all four classes the amount of time available to the teacher for 
individual instruction was practically nil. 

4. The teachers had not had clearlv in mind what constitutes 
desirable standards of promotion from one class to another, with 
the result that the classes were poorly graded. 

5. Each class had a relatively large number of mentally 
defective children who were incapable of profiting by classroom 
instruction in large groups. 

At the opening of the fall term 1919, principals were invited 
to join new Self-Survey Classes along the lines described above. 
Twenty-two of the original twenty-eight principals registered for 
membership in an advanced class, while fifty-four other principals 
registered for elementary classes, necessitating the formation of 
four sections in the Self-Survey Class, three for beginners and one 
for advanced students. The work of the beginners for 1919-1920 
will be to cover the better known educational tests, while the 
advanced pupils will study especially group intelligence tests. 

Considerable attention has already been given to the Group 
Point Scale of Intelligence "Schedule D" devised by Dr. and 
Mrs. Pressey of Indiana University.* This is being given to a 
large number of A6 classes with some very interesting results. 
Later on, it is planned to experiment with the Otis Group Tests 
in eighth-grade classes. The advanced section of the Self-Survey 
Class will experiment also with Dr. Strayer's Score Card for City 
School Buildings. Los Angeles has many types of school build- 
ings, and it is believed that an intensive study of the construction 
of these will result in an awakened interest in better buildings. 

* Pressey, S. L. and L. W. "A group point scale of intdligcncc," Journal €§ 
Applied Psychology f 2:250-69, September, 1918. The test may be purchased from 
Indiana University, Bloomington, Indiana. 



ANALYSIS OF AND TESTING IN COMMON FRACTIONS 

Arthxtb W. Eallom 
Department of Educational Investigation and Measurement^ Boston^ Massachusetts 

In spite of all that has been written in regard to simplicity 
of work in common fractions, the latest books still continue to 
give examples involving large denominators and, in the operations 
of addition and subtraction, continue to use fractions which 
involve a common denominator so large that the pupils cannot 
use it to advantage. 

In Boston, by the terms of the new course of study, teachers; 
have been asked to restrict their work with fractions to those 
having a denominator not larger than sixteen and a common de- 
nominator not larger than one himdred, and to eliminate all 
imusual fractions, such as elevenths and thirteenths. This was 
later emphasized by a test in the four operations prepared by 
the Department of Educational Investigation and Measurement. 

Organization of Work in Fractions 

Organized work in the study of common fractions was insti- 
tuted in Boston in December of 1914 by the appointment of a 
committee of teachers and masters. This committee cooperated 
with the Department of Educational Investigation and Measure- 
ment of the city in the hope of organizing a standardized test in 
the four operations in fractions. Several months were devoted to 
the problem, most of the time being consumed in the study of 
addition and subtraction. In its study the committee distin- 
guished fourteen distinct types of examples in addition and seven 
in subtraction. The following analysis will show that the classi- 
fication into the fourteen types in addition is based on two factors, 

the common denominator and the form of the answer. . 

«- 

Analysis of Type Examples in Addition of Two Fractions 

Groups of two or more fractions may be divided into two 
classes, similar and dissimilar. Similar fractions are defined as 
fractions having the same denominator. Dissimilar fractions 
are those which have different denominators. Each one of these 
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dasses may be farther subdivided according to whether the result 
obtained from adding is non-reducible or reducible. If the result 
is non-redudble, the answer is in an acceptable form after the 
numerators of the similar fractions have been added. If the 
result is reducible, it may be changed to a mixed number, to 
lowest terms, or to both, before the answer can be said to be in an 
acceptable form. A discussion of the fourteen tjpes is given 
here because it is believed that the recognition of them will be 
helpful to teachers in instructing chfldren in the addition of 
fractions. The reader should bear in mind that these tjpes 
occur in the addition of two fractions and that the addition of 
two mixed numbers or a mixed number and a fraction probably 
creates other types as do examples having three or more addends. 

A. Similar Fractions 

Four types are all that are possible when fractions are similar. 
Type 1. — ^After adding, the result is non-redudble. 

For rrampir: 749 

Type 2. — ^After adding, the result is reducible either to an 
integer or to a mixed number. 

For example: a a q 1 

Type 3. — ^Af ter adding, the result is reducible to lowest terms. 

For example: e f < 9 

Type 4. — ^After adding, the result is reducible both to lowest 
terms and to a mixed number. 



For example: 5 5 jq 5 2 



B. Dissimilar Fractions 

Under the heading of dissimilar fractions there are three 
divisions depending on the common denominator. 

a) When the least common denominator is the denominator 
of one of the fractions. 

b) When the least common denominator is the product of 
the denominators. 
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c) When the least common denominator is found by factoring. 
These will be considered in order. 

a) When the least common denominator is the denominator 
of one of the fractions, there are four types, one non-reducible and 
three reducible, similar to the preceding four types. 

Type 5. — ^The denominator of one of the fractions is the least 
common denominator. After adding, the result is non-reducible. 

For example: 137 

Type 6. — ^The denominator of one of the fractions is the least 
common denominator. After adding, the result is reducible to 
a mixed number. 

For example: o 7 11 1 

Type 7. — The denominator of one of the fractions is the least 
common denominator. After adding, the result is reducible to 
lowest terms. 

For example: 1^04 

Type 8, — ^The denominator of one of the fractions is the least 
common denominator. After adding, the result is reducible to 
lowest terms and to a mixed number. 

For example: ^ e 14 7 \ 

b) When the least common denominator is the product of 
the denominators, there are only two types, one non-reducible 
and the other reducible to a mixed number. After reducing 
fractions of these two types to similar fractions and adding the 
numerators, the result is always a fraction in which the numerator 
and denominator are prime to each other. This makes it impos- 
sible to obtain a result which can be reduced to lowest terms. 

Type P. — The denominators are prime to each other, hence 
the common denominator must be the product of the denomina- 
tors. After adding, the result is non-reducible. 

For example: ^ ^ 1^ 
5"^8"40 
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Type 10. — The denominators are prime to each other, hence 
the common denominator must be the product of the denomina- 
tors. After adding, the result is reducible to a mixed number. 

For example: 7 i 37 « 

c) When the least common denominator is found by factor- 
ing, there are four types, one non-reducible and three reducible. 

Type 11. — ^The least common denominator is foimd by factor- 
ing. After adding the result is non-reducible. 

For example: \ n 1 
6"^9"l8 

Type 12. — The least common denominator is foimd by fac- 
toring. After adding, the result is reducible to a mixed number. 

For example: 1543 1 

Type 13. — The least common denominator is found by factor- 
ing. After adding, the result is reducible to lowest terms. 



For 



example: 1793 



6"^15"30'"10 



Type 14. — ^The least common denominator is found by factor- 
ing. After adding, the result is reducible to lowest terms and 
to a mixed number. 

For exaix^)le: 1 9^ 32 16 J_ 
6"^10"30''l5"^15 

Analysis of Type Examples in Subtraction of Fractions 

There are seven distinct types when one fraction is subtracted 
from another. Owing to lack of space the analysis for subtraction 
of fractions is not given, but it is on the same basis as has been 
shown in addition of fractions. The reason for the smaller num- 
ber of types is because of the impossibility of subtracting one 
fraction from another and obtaining an integer or mixed number 
for an answer. Thus there are no subtraction types analogous to 
Types 2, 4, 6, 8, 10, 12, and 14 in addition. Besides the seven 
types there are, of course, the subtraction of a mixed number 
from a whole number or a mixed number from a mixed number. 
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Analysis of Types in Multiplication and 
Division of Fractions 

When the cominittee approached the study of multiplication 
and division of fractions, they did not deem it wise to make so 
extended an analysis. In these two processes the separation 
into types depended upon the character of the multiplier and 
multiplicand or the dividend and divisor. Reducible and non- 
reducible cases were not distinguished. The analysis of multi- 
plication was as follows : 

Multiplication of: 

Fraction by a whole number 

Mixed number by a whole number 

Whole number by a fraction 

Whole number by a mixed number 

Fraction by a fraction 

Mixed number by a fraction 

Mixed number by a mixed number 
The multiplication of a fraction by a mixed number was not 
included because there is little or no use for it in adult practice. 
In division of fractions the process is either one of two pro- 
cedures. In the first case, one proceeds to find how many times 
one number of a certain denomination is contained in a larger 
number of the same denomination. That is, this process is to 
determine how many measures of a certain size there are in a 
measure of a di£ferent size. This type of procedure has been called 
division by measuring. In the second case, one proceeds to 
separate a number into a certain number of parts and to find out 
the size of each part. This type of division is called division by 
parting. These two cases, measuring and parting, became the 
basis upon which the analysis in division of fractions was made. 
In view of these conditions, the following types were selected. 
Division of: 

Frac!tion by a whole number (parting) 
Mixed number by a whole number (parting) 
Whole number by a fraction (measuring) 
Whole number by a mixed number (measuring) 
Fraction by a fraction (either) 
Mixed number by a fraction (measuring) 
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Preliminary Work 

A part of the preliminary work of the teacher committee, 
prior to any testing, consisted in devising a diagnostic sheet in 
addition for the use of the teachers. It consisted of 12 examples, 
one each of Types 3 to 14 inclusive. This sheet of 12 examples 
was called a form. In order to give the teacher plenty of material 
to work with, ten different forms were organized. Figure 1 
represents Form 1. 

FIGURE 1. DIAGNOSTIC SHEET FOR ADDITION OF FRACTIONS 

FORM 1 

Score Time Name. 



(A) _3_ 
16 


(B) 


5 
6 


(C) 


2 
3 


(D) 


3 
4 


7 
16 




5 
6 




4 
15 




7 
8 


(E) 1 
2 


(F) 


6 

7 


(G) 


2 
9 


(H) 


1 
4 


3 
10 




9 

14 




10 




8 
9 


a) 3 

8 


a) 


7 
9 


(K) 


1 
6 


(L) 


5 
6 


7 
12 




8 
15 




10 




3 
14 



The letters at the left of each example indicate the type to 
which the example belongs. The first example on the sheet 
lettered "A'' represents Type 3, "B" represents Type 4, "C" 
represents T)^e 5, etc. On account of their simplicity, T)^es 1 
and 2 were omitted from these forms. 

In using the forms the teacher gives each pupil a sheet on 
which is printed these twelve examples, or twelve others similar 
to those represented in Figure 1, and requests him to do the 
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examples as quickly and accurately as possible, placing the answer 
on the sheet. After all the children have finished, the work may 
be corrected by the pupil or by the teacher. A record of incorrect 
examples may be kept on a sheet such as the one represented by 
Figure 2. 

FIGURE 2. SCORE SHEET FOR KEEPING THE RECORD OF A PUPIL 

IN THE ADDITION OF TWO FRACTIONS 



Name 


>••••• 








. . . .Grade. . . 




. . . .Room. . . 




Examples 


Form 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


A 


















B 






















C 






















D 






















E 






















F 






















G 






















U 






















I 






















J 




• 


















K 






















L 






















Score 






















Time 
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This sheet may be used to preserve the record of each pupil's 
work. The letters in the first vertical column correspond to the 
letters on Form 1 (p. 182). After correcting the examples of this 
form, the teacher or pupil records the results in the column 
devoted to Form 1. Those pupils having a perfect score need not 
waste their time taking any further forms. Those having wrong 
work should be given necessary help on the type or types in which 
they failed: and after some drill, they may take a second test 
represented by the second form. The results are recorded in the 
colunm headed "Form 2," and so on. The teacher thus has a 
continuous record of each pupil. By means of this record a 
diagnosis of the pupil's difficulties is provided. Effort may be 
concentrated where it is needed. 

Figure 3 shows the record of a girl, M. F., in grade v. A 
check mark indicates that an example was right, a cross that 
an example was wrong. The first column shows her result on 
Form 1. In the succeeding vertical columns is indicated her 
results on Forms 2, 3, 4, etc. For example, in Form 1, M. F. 
failed in every type except Type 3 (A) . She received individual 
help and a few days later attempted Form 2, composed of exam- 
ples similar to those of Form 1. M. F. was then able to do all 
but Types 8 (F), 9 (G), 13 (K), and 14 (L). 

After each form is offered, corrective material is given, lajdng 
stress upon the type in which the individual has failed. Figure 3 
shows that in succeeding tests, although M. F. fails in various 
types, Type 9 (G) persists as a "trouble maker" until the seventh 
form has been given. Type 13 (K) is solved correctly on the 
fourth form, but not again until the tenth form; while Type 14 (L) 
is solved correctly for the first time at the sixth trial. 

Even the ten trials, however, are not enough to fix these two 
types. Type 12 (J) is "in and out." Of course, only the papers 
themselves show the trouble in complete detail, but this kind of 
sheet makes a permanent record which is very valuable to both 
pupil and teacher. This pupil has made a gain, for she has not 
only been able to get the examples of each type right at least 
once, but she has also been able to decrease her time from nine 
minutes to five, as indicated on the lowest horizontal line. 

Thus, the teacher is able by such a selected group of examples, 
to diagnose the difficulties of her pupils in addition of fractions. 
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FIGURE 3. RECORD OF M. F. IN ADDITION OF FRACTION 



Name M . 7 . 



Grade V 



Room 156 



Examples 


Form 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


A 


V 


V 


V 


V 


V 


X 


X 


X 


X 


V 

1 


B 


X 


V 


X 


V 


V 


V 


V 


V 


X 


V 


C 


X 


V 


X 


V 


V 


X 


V 


V 


V 


V 


D 


X 


V 


V 


V 


V 


V 


V 


V 


V 


V 


£ 


X 


V 


V 


V 


V 


V 


X 


X 


X 


V 


F 


X 


X 


V 


V 


V 


V 


V 


V 


V 


V 


G 


X 


X 


X 


X 


X 


X 


V 


V 


V 


V 


H 


X 


V 


V 


V 


V 


X 


X 


V 


V 


V 


I 


X 


V 


X 


X 


V 


V 


V 


V 


V 


V 


J 


X 


V 


V 


X 


X 


V 


X 


V 


V 


X 


K 


X 


X 


X 


V 


X 


X 


X 


X 


X 


V 


L 


X 


X 


X 


X 


X 


V 


X 


X 


V 


V 


Score 


1 


8 


6 


8 


8 


7 


6 


8 


8 


11 


Time 


9 


10 


8 


13 


13 


16 


8 


8 


8 


5 



Children are growing more and more interested in drawing 
graphs of their work. This task is simple and comparatively 
easy when cross-section paper is used. For this work in addition, 
two lines are drawn at right angles to each other and each twelve 
spaces long (Figures 4-9). Just below the horizontal line are 
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placed the twelve letters indicatiiig the types of examples, one 
in a square. Along the vertical line are shown the percents of 
the total test, ranging from to 100. 

If the example A is right, a short line is drawn from the zero 
point diagonally upward across the square above A. For each 
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additional correct example a short line is similarly drawn above 
the tY^ letter making a continuous curve. In this way, if all 
examples are right, the curve will be a straight line at an angle of 
45 degrees to the horizontal. If an example is wrong a short 
horizontal line connected with the previous part of the curve is 
drawn along the base of the appropriate square. Thus the con- 
tinuous curve will receive no elevation for an incorrect example. 

Figures 4 to 9 inclusive show graphically the performance of 
M. F. on Forms 1, 2, 3, 4, 6, and 10 respectively (see Figure 3). 
Observe that the end of the curve, when completed, automatically 
indicates the percent of accuracy for the form to which the curve 
applies. Thus in the case of M. F., Figure 4 shows that the score 
on Form 1 was 8 1/3 percent. According to Figure 5, her score 
on Form 2 was 66 2/3 percent. Figure 9 shows a percent of 
91 2/3 for Form 10. 

The shape of the curve also indicates, in some measure, the 
way the pupil learns. The interest of the pupil is held in attempt- 
ing to make a straight line. The plan, therefore, becomes a real 
means of motivating the work. 

These two methods of keeping a record enable the teacher to 
determine at once where the pupil is having difficulty, and it must 
be remembered that a pupil's ability to add fractions is no greater 
than his ability in each one of these fourteen types. Such 
records indicate that a pupil may be able to do the simpler types 
without being able to do the more complicated ones — e.g., Types 
13 and 14. In other words, the general knowledge that a pupil 
can or cannot add fractions is not sufficient. On that basis no 
teacher can accurately diagnose difficulties or intelligently apply 
remedies. It is only when the teacher takes the various possi- 
bilities — ^possibilities such as this analysis of operations in adding 
fractions supplies — and tests the children with all of these that 
she is able to determine whether each pupil will probably be able 
to add any example in fractions with which he may be confronted. 

Monroe directs attention to this same fact when he calls "the 
situation which the teacher faces a complex one." He adds that: 
"Before she can intelligently direct her eflforts as an instructor she 
must diagnose the situation."^ This may be done only by taking 
all the possibilities into consideration. 

* Monroe, Walter S. and De Voss, J. C. and Kelly, F. J. Educational tests and 
measurements, Boston: Houghton Mifflin Co., 1917, p. 49. 
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Results or Puxdoxasy Wokk 

Fonns sunilar to those in Figure 1 'page X^T" were used in the 
fifth grades of five districts in Boston in the spring of 1915. Hie 
results erf this testing, as sent to the omce of the department^ 
showed that in general the accuracy increased and the time 
necessary to do the examples shortened as the diikiren woiked 
each successive form. In addition to this, the data gathered 
from this material showed: 

a) That testing of this kind wou!d be fikdy to produce results 
which would show the abilitv of children to add fractions. 

b) That children might be able to do non-reducible types but 
would have trouble in doing types where reduction was 
necessary. 

c) That the time required to do the twelve examples on each 
form varied greatiy. The shortest time recorded by an 
individual was two minutes and the longest forty-one 
minutes. 

Similar forms are now being printed for use in subtraction, 
multiplication, and division of fractions. 

Suggestions for Diagnosis 

It has been pointed out in the foregoing that satisfactory 
diagnosis can be carried on only when all t>i>es are represented. 
The knowledge that a pupil can multiply 456 1/3 by 2 is not 
sufficient, because the example is so constructed that it does not 
bring in all the elements of a mixed number multiplied by an 
integer. A pupil may do this type without being able to do a 
similar example when the product of the fraction by the integer 
is equal to or more than a whole number. 

What is meant, then, by diagnosis? By diagnosis is meant 
noting certain existing symptoms and finding out from them what 
is the trouble. This is usually done by correcting the pupil's 
examples. Each pupil may have a dilBFerent trouble and, there- 
fore, require a diflferent treatment. Thus the importance of the 
individual is brought to the front. There may be two reasons 
for looking over a set of papers: (1) simply to mark examples 
right or wrong; (2) to gain some knowledge which will tend to 
correct pupil's work. Diagnosis emphasizes the latter reason. 
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There are four principles which underlie any diagnosis of the 
results of a test aside from the necessity of having all types of 
examples represented. 

a) Trouble with individual pupils cannot be discovered by 
studying and emphasizing the work of the children who have 
examples right. The principle that success comes through failure 
must be practiced here, and the teacher will find her richest 
material for study in the poorest papers. 

b) After selecting the papers with low scores it is necessary to 
find out from each paper, if possible, how the pupil did his work. 
The fact that a pupil usually does each type of example in the 
same way makes this possible in a large number of cases. In 
many cases, however, it is not possible to determine how the 
work is done because of the queer methods used by different 
individuals. The following are a few of the methods used by 
pupils in a test given in December, 1917: 

(1^ Z75 iz) Aj^^y^^yli 

Z3 -4x543 ' I? 

ZZOO ' -8^175 ^^ *. ^ 7Z fu 7/ ^ 

^ X j^ =^/5 (6^39*1) 3% ^375 (J. 75) 

Vs '^ZO i.ZO) 



■ t3 
Z0)375 



5^x6 = 
3 

3jlBZ 



'^ 




All the methods illustrated above, with many others, show 
the almost unbelievable ways used by children even though they 
have been taught proper methods. If an examination of the 
paper fails to show how the work was done, then a session with 
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the pupil is, of course, necessary. What is essential to discover 
is whether the pupil has anything to build upon. If he has little 
except a collection of bad habits, then there is a long, weary 
struggle to overcome these habits and establish habits of right 
thinking and right action before results can be obtained. For in 
the last analysis accuracy in all mechanical work depends upon 
the formation of right habits of work. 

c) The nature of the corrective material to be given is deter- 
mined by the results of the study of the papers made under (a) 
and (b). To try to determine this before the study means 
wasted time for both teacher and pupil. 

d) The most important step of all is the keeping of a record 
of each pupil's performance. In no other way can one tell 
whether the pupil is advancing or not 

Plan of Recording Results 

As a result of this study of common fractions, how may a 
teacher effectively check the work in her grade? How may she 
determine, and keep in some permanent form, a record of the 
pupil's ability in the four operations in common fractions? The 
accompanying form of record (Figure 10) has been used and has 
proved effective. This sheet may be duplicated so that each 
pupil may have a copy. It was planned to be used as follo¥^: 

The teacher may give examples in addition similar to the 
types illustrated on page 178 or she may give examples of the 
various types into which the other three operations have been 
analyzed. 

If the pupils get the answers right, the appropriate types may 
be checked in the column marked "R," if wrong they may be 
checked in the column marked "W." The checks in the "wrong" 
column should be changed as fast as the pupil has mastered the 
types, or a separate record sheet may be used for each trial. After 
giving a series of lessons covering the various types and recording 
results, the teacher has a record of the ability of each individual 
in the room showing his strength and weakness. If a pupil fails 
in a verbal problem, it can be determined immediately by refer- 
ence to this record whether or not the difficulty is in the mechanics 
of the problem. The mechanics may be wrong, and still the 
pupil may have shown in previous work that he knew how to do 
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nCURE 10. RECORD IN COMMON FRACTIONS OF 



Name. 
Age... 



School. 
Room. 



Grade. 



Addition 

Type 1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

Mixed numbers . . 



W. 



Multiplication 

Fraction by an integer. . . 

Integer by a fraction 

Integer by a mixed number 

Mixed number by an in 
teger 

Fraction by a mixed num- 
ber 

Mixed number by a frac 
tion 

Fraction by a fraction 

Mixed number by a mixed 
number 



W. 



Subtraction 
(Without "Borrowing*') 
Type 1 



2. 
3. 

4. 
5. 
6. 
7. 



Fraction from mixed num 

ber 

Mixed number from mixed 
number (with "bor- 
rowing") 

Fraction from integer 

Fraction from mixed num 

ber 

Mixed number from integer 

Mixed number from mixed 

number 



Division 

Fraction by an integer. . . 

Integer by a fraction 

Integer by a mixed number 

Mixed number by an in 
teger 

Mixed number by a frac- 
tion 

Fraction by a fraction. . . 
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the type of mechanical work involved. If so, the teacher's work 
ahould be quite different from what it would be if the pupil did 
not know the mechanics involved. In any case, the inq[>ortant 
point is that the teacher can easily tell from her record in what 
way and to what extent she should help the pupiL 

Conclusions 

I. Modem teaching requires an analysis of conditions 
such that the teacher may know aU the possibilities in the subject 
under discussion. 

II. Knowledge of the subject demands knowledge of all 
)>iirts of the subject as determined by the analysis which has 
been made. 

III. Diagnosis of results depends upon four principles: 

1. Study the papers of the poorest pupils. 

2. Find out how each pupil did his woric. 

3. Determine from this the kind of corrective material 
to be given. 

4. Keep a record of each pupil's performance. 




THE ENCOURAGEMENT OF INDIVIDUAL 

INSTRUCTION BY MEANS OF 

STANDARDIZED TESTS 

Matthew H. Willing 

UniversUy School, Cleveland, Ohio 

To encourage an intelligent individualization in school instruc- 
tion is, to the writer's mind, the most pressing duty of modem 
educational supervision. It is one aspect, and that a decidedly 
technical one, of the whole movement toward adapting the school 
to the individual. The general problem has been attacked 
administratively in reforms relating to promotion, grading, the 
size of classes, and the nature and extent of the curriculum. But 
in the teaching process there have been few evidences of an appre- 
ciation of the problem. Regardless of improved grading, reduced 
classes, greater flexibility of promotion, and the like, the teaching 
technic still remains largely managerial rather than tutorial. 
The existence of individual differences is readily enough admitted, 
but they are rarely defined or their extent calculated. Their 
implications for instruction are pretty widely ignored. Alert 
supervision will tend to change this situation; will challenge the 
sanctity of the eternal test recitation; will decry uniform assign- 
ments and uniform drill; will insist on analytical marking; will 
stimulate teachers and pupils alike to determine individual needs 
and apply individual remedies. 

As an instrument in bringing about the desired change in 
instructional emphasis, the standardized test is helpful. In three 
ways, at least, it meets initial problems. (1) It furnishes concrete, 
intelligible evidence of the presence and extent of individual differ* 
ences within school groups. (2) It defines, in many instances, the 
exact nature of the differences or makes such definition possible. 
(3) It permits the establishment of definite standards for individual 
accomplishment in many fundamental phases of school learning. 

Little need be said of the service performed by standardized 
tests in revealing the variation in ability within school groups. 
Throughout the now abundant literature on the measurement of 
achievement in school subjects a foremost place has been given to 
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the phenomena of individual diflferences and their implications. 
It has been stated repeatedly that an average is a feeble guide for 
instruction when compared with a distribution table, and that for 
the teacher the most important data from these tests are not 
a>*erages, or medians, or other records of central tendencies, but 
rather the indi\*idual deviations from these measures of type. 
Statistical, N-erbaK and graphical representation of such deviations 
are the dex'ices to use in making teachers conscious of the most 
sij^nincant facts about their pupils. The great advantages which 
such representations have when derived from standardized tests 
are their provision and the fact that they have a common meaning 
for ixl\ who understand them. 

AlmvVit from the outset, however, any supervisor who uses the 
Ht Ambrviixevl test to induce greater indiWdualization of instruction 
will tuut it necessary to supplement the mere statement of indivi- 
duiil ditYetences with precise information as to their nature. 
Kxcept in the most simple kinds of school work a mere score is 
not inuticubrly illuminating, even though the unit of measure is 
dctiutsi. A standardized test is helpful to the teacher in just about 
tho ilo^ree that it is itself diagnostic or makes diagnosis possible. 
Furthermore, it is helpful in just about the d^ree that the 
teiu her exploits the diagnostic possibilities herself. 

The way to do this, however, must be shown. As an illustra- 
tion of the treatment that may be gi\'en profitably to the papers of 
a stamlar\ii^e\l test, deNised to permit diagnosis, the following 
tthridgeil suiHTvis^>r*s report on the accomplishment of a seventh 
grade is otTerx\l. The material is Monroe's Reasoning Test in 
Arithmetic Test II, Form 1, given Januarj' 28, 1919.* 

The m<\lian *oores made in this test by the two seventh grade classes 
an? as tolK^ws: 



Claw 


Rate Score 

13.7 
It 1 


Principle Score 


Accuracy Score 


Mr. K*s Cla**, . , . 
Mr. \V*s Class,.., 


23.6 
19.8 


15.1 
15.5 


Monroe's Tentative Standards 


21 


14 



> For detailed description of this test see Walter S. Monroe's Meastirini the Resniis 
of Teackimg. A copy of the test can be obtained from the Bureau of Educational 
Research, University' of Illinois, Urbana, niiiw^ 
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One class appears to be about as capable as the other in this test, while 
neither is at present much above the tentative standard. There is a slight 
indication that Mr. E's pupils are less accurate than Mr. W's. This appar- 
ent difference, however, may be wholly due to the time of day when the 
test was given to the respective classes. Mr. W's class was tested in the 
morning at the second period, while Mr. E's was not tested till afternoon at 
the eighth period. Pupils of this age may be less painstaking and accurate 
at the dose of a long school day than at the beginning. 

The sixth grade was given the same test a few days earlier and scored as 
follows: rate 7.7, principle 15.5, accuracy 10. Pupils in the seventh grade 
making lower scores than these, clearly need to be made subjects of special 
attention at once. A list of such is given herewith:* . . . 

This test calls for ability in the fimdamental operations with integers, 
common fractions, and decimals. The actual mechanical processes involved 
are not such as to tax any seventh grade child provided with average prepara- 
tion. The types of reasoning called for are also completely within the 
experience of boys and girls of this grade, and no problem demands more 
than two steps. In the case of only two problems have our pupils any 
exciise for failure on the plea of lack of training; namely, the eleventh and 
the thirteenth. The eleventh calls for an understanding of the simplest sort 
of commercial accoimting, and the thirteenth requires a knowledge of the 
number of poimds in a ton. So little attention has been paid as yet to com- 
mercial forms, and so long a time has elapsed since the intensive study of 
denominate numbers, that many failures in the problems named were to be 
expected. 

The following list of reasons for failing in principle or in acc\iracy of 
calculation covers the present situation pretty completely, as revealed by 
the papers themselves: 

ESKORS 

A. In Principle: 

1. Faulty reasoning 

2. Careless reading 

3. Apparent ignorance of terms and concepts used 

4. Incorrect statement of division (J^-t-6 instead of 6-r J<), 
though correct operation 

5. Additional operations not called for 

B. In Accuracy: 

6. Errors in fimdamental operations with integers 

7. Errors in manipulating common fractions 

8. Errors in placing decimal point 

9. Error in copying 

10. Skipped problem; probably imable to solve. 

' In the original rqx>rt, names of pupils were given at this point. 
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Table I contains a brief description of each problem, the 
number of pupils attempting, the number scoring inprindplei 
the number scoring in accuracy, and a record of the more 
common errors with the number of pupils (in parentheses) nmlring 
each error.* 



< 


TABLE I. 


PROBLEM RECORD 






ATTEMPTS 


NUMBER OF FUFILS HAVOTO 


TYPBSOF 


pmOBUEX 


Principle 
Correct 


Answer 
Correct 


ERXOSS 


1. 

Doe step. 

(a+b-?) 

Addition of fractions 


41 


39 


37 


1(2), 6{2) 


2. 
One step. 

(a-b-?) 

Subtraction of fractions 


41 


38 


27 


7(7), 9(2), 1(2) 


5. 
Two steps, 
(a+bxc-?) 
Div. and mult of dec 


41 


37 


35 


1(4), 6(2) 


11. 
Two steps. 

(a+b+ . . . -h=?) 
Addition and sub. of dec. 


31 


7 


3 


3(20), 10(10) 



In the original report there followed here a lengthy discussion 
of each of the ten types of error recognized, with a statement of 
the number of pupils making each error, together with names in 
aggravated cases. Then a final table was offered giving the 
individual records of the pupils on each problem, on types of error, 
and in the various test scores. This table was presented in the 
accompanying form (Table II). 



I Only four of the fifteen problems are here shown. Forty-one pupils took the 
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TABLE n. INDIVIDDAL KECOKD 



■s 




Pnblenu 


£ 


, 


J 


1 


* 


s 


. 1 




Enor 

Cnail-.., 


Pi, 


Ac. 


Pr. 


At, 


Pr. 


Ac, 


Pr. 


Ac. 


Tf. 


Ac. 


"■ 


; 


A 














, 


1 


7 



, 











» 


Error 

Cnrfil. . . . 


, 


, 







, 


, 














, 




































s: 


Tot 
Pr 




IS 

Pr. Iac 


Tot 
At 


1 





n 


, 


, 


, 


1 


,5 


„ 


, 













The reader will observe that the above table is broken between 
the sixth and fifteenth problems. The Total Attempts, Total 
Credits in Principle and Total Credits in Accuracy are not therefore 
the totals of the figures actually shown. The table reads : Pupil A 
made errors of Type 1 in principle (see code above) on problems 
1, 2, S, 6, and 15. He obtained credit in principle on problems 3 
and 4 with one additional credit on a problem not shown, thus 
making the 3 credits indicated under "Tot Pr." He also ob- 
tained a credit in accuracy on problem 3, and on no other, thus 
making the total credit of "1" indicated in the last column. It is 
to be noted that if there is an error in principle on any problem no 
credit for accuracy is possible. 

A supervisor speedily discovers that the giving of tests, the 
demonstration of pupil variation, and the explicit diagnosis of ' 
individual weaknesses will not of themselves guarantee any 
marked change in teaching method. Group methods constitute 
too much of an obsession to be easily thrown off even in part. 
It must be made insistently clear that the results desired from 
teaching are individual results and not class results. 

The standardized test performs a distinct service in pointing 
out where to look for specific troubles when minimum require- 
ments are furnished in terms of the units of the test. For 
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example, standards in handwriting may be stated in some such 
form as the one shown in Table III. 

TABLE III. STANDARDS IN HANDWRITING 



Grade 


A>Tes' Quality 


Letters per Mm. 


Percent of Qaas 


III 


40 


45 


80 


IV 


40 


50 


80 


V 


50 


55 


80 


VI 


50 


60 


80 


VII 


60 


65 


80 


vin 


60 


70 


80 



A similar statement of standards is possible today in practically 
all elementary-school fundamentals and in certain high-school 
subjects as well. Increased individualization is sure to follow 
such prescriptions, for in no other way can the required results 
l>e achieved with reasonable economy. 

The extensive use of the standardized test for the purposes 
outlined above, if for no other, is strongly recommended to super- 
\nsors. It will do a great deal at once to center attention on the 
pupil instead of on the class. It will not solve the ultimate piroB^ 
lem of teaching technic, but it will produce the necessary ante- 
cedent conditions of enlightenment and stimulation. Therefore, 
when this report was submitted, the teachers were asked to make 
it the basis not only of a more analytical procedure in terms of the 
subject, but, especially, of a more individualized procedure in 
terms of the pupil. Attention to the specific troubles of each of 
these pupils as revealed in the Individual Record (Table II) was 
held to be far more profitable than marshaling them as a group 
through daily recitation maneuvers. 




CORRELATION OF PHYSICAL HEALTH AND 

MENTAL EFFICIENCY 

R. L. Sandwick 
Principal, Deerfidd-Skidds Taumskip High School, Highland Park, Illinois 

The following study, made in one school, of the relation between 
mental power as determined by an intelligence test and compara- 
tive freedom from physical defects, is submitted to the Journal 
OF Educational Research in the hope that similar studies may 
be made in other schools. It is important to know whether the 
remarkable parallelism between mental inefficiency and physical 
defects here shown is merely accidental, or indicative of a general 
condition. 

The Group Intelligence Test by Rugg and Freeman* was 
given to 423 of the students enroUed in the Deerfield-Shields 
High School on September 18, 1919. The statistical work in 
connection with the test was handled by Mr. Harry G. Pertz, 
who presented, among other matters, a chart showing the scores 
of the forty ablest students as determined by the test, and of the 
forty students making the lowest scores. He also arranged the 
whole 423 students in order of scoring ability from the highest 
with a score of 81.5 to the lowest with a score of 8. 

Mr. Pertz had made a similar gradation of these students a year 
ago after all of them had taken the Kansas Silent Reading Test. 
In general the two tests show parallel ability. Most students 
who ranked high in the Kansas Silent Reading Test also ranked 
high in the Group Intelligence Test. There were a few con- 
spicuous examples of the failure of this general rule. One student 
who ranked seventy-ninth in the test last year ranked second this 
year. It was known that this particular boy had had some rather 
serious physical defects remedied by surgical operation — defects 
which had interfered with his health the previous year. He had 
spent the summer on a farm in the open air, and had gained about 
thirty pounds in weight in a year's time. Being impressed by 

* The Freeman-Rugg Group Intelligence Tests were designed to measure the 
general intelligence of junior and senior high-school pupils. Address, University of 
Chicago Bookstore, Chicago, Dlinois. Price 5 cents a sample set; 3 cents each in 
quantities. 
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TABLE I. STUDENTS HAVING FORTY HIGHEST SCORES 



Student 


InteUigence 




No. 


Score 


Physical Defects 


1 


81.5 


No defects 


2 


78.0 


No defects 


3 


75.0 


No defects 


4 


75.0 


Teeth 


5 


73.5 


No defects 


6 


72.5 


No defects 


7 


71.5 


No defects 


8 


71.0 


No defects 


9 


71.0 


No defects 


10 


70.0 


No defects 


11 


70.0 


No defects 


12 


70.0 


Teeth, vision (not bad) 


13 


70.0 


Skin disease (slight) 


14 


69.0 


Teeth 


15 


67.0 


No defects 


16 


66.5 


No defects 


17 


66.5 


No defects 


18 


66.0 


Vision (slight), teeth (not bad), ^ands (temporary 
from cold) 


19 


66.0 




*^ 


*^^^ m ^^ 


tion) 


20 


65.5 


Pulmonary disease, nasal breathing 


21 


65.5 


Slight acne, hearing (from cold) 


22 


64.5 


Teeth (small filling dropped out) 


23 


64.0 


No defects 


24 


64.0 


No defects 


25 


64.0 


No defects 


26 


64.0 


No defects 


27 


64.0 


Cardiac (result of influenza) 


28 


63.5 


Vision (wears glasses) 


29 


63.0 


No defects 


30 


63.0 


Tonsils (temporarily enlarged) 


31 


62.5 


^sion (eyes slightly crossed) 


32 


62.5 


Cardiac 


33 


62.5 


Tonsils 


34 


62.0 


Teeth (not serious) 


35 


62.0 


Tonsils (from cold), vision (slight astigmatism), glands 


36 


62.0 


No defects 


37 


61.0 


Christian Scientist (excused from physical examina- 
tion) 


38 


61.0 


Tonsils (slightly enlarged), teeth 


39 


60.5 


No defects 


40 


60.0 


No defects 



1 
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TABLE n. STUDENTS HAVING FORTY LOWEST SCORES 



Student 


Intelligence 




No. 


Score 


Physical Defects 


1 


29.5 


Skin, cardiac, piilmonary 


2 


29.5 


Nervous disease, cardiac, pulmonary, tonsils, adenoids 


3 


29.0 


Enlarged glands, goitre, cardiac disease, skin, vision, 
teeth, tonsils 


4 


29.0 


Enlarged glands, cardiac, pulmonary, orthopaedic 


5 


29.0 


Enlarged glands, goitre, pulmonary, other defects of 
eye, tonsils, teeth 


6 


29.0 


Enlarged glands, vision, nasal breathing, tonsils 


7 


29.0 


Cardiac, pulmonary, orthopaedic, vision, tonsils 


8 


28.5 


Glands, vision, nasal breathing, tonsils 


9 


28.5 


Pulmonary, vision, teeth, tonsils 


10 


27.5 


Enlarged glands, cardiac, pulmonary, vision 


11 


27.5 


Enlarged glands, cardiac, pulmonary, vision, teeth, 
tonsils 


12 


27.0 


Enlarged glands, goitre, tonsils 


13 


27.0 


Tonsils, vision 


14 


27.0 


Pulmonary, teeth 


15 


27.0 


Tonsils, teeth 


16 


27.0 


Teeth, tonsils, adenoids 


17 


26.5 


Teeth, tonsils, adenoids 


18 


25.0 


Glands, skin disease 


19 


25.0 


Glands, goitre, cardiac 


20 


24.5 


Enlarged glands 


21 


24.5 


Tonsils, vision, cardiac 


22 


24.5 


Vision, goitre 


23 


21.0 


Cardiac, teeth, vision, tonsils 


24 


21.0 


Vision, goitre 


25 


20.5 


Cardiac, skin, rachitic type, teeth, tonsils 


26 


20.5 


Pulmonary, tonsils 


27 


20.0 


Cardiac, teeth, tonsils 


28 


20.0 


Teeth, adenoids 


29 


19.0 


Vision 


30 


19.0 


Enlarged glands 


31 


18.0 


Teeth, nasal breathing 


32 


17.0 


Enlarged glands, goitre, cardiac, teeth, tonsils 


33 


15.5 


(Not examined) 


34 


15.0 


Nasal breathing, teeth, glands, tonsils 


35 


14.0 


Teeth, goitre, glands 


36 


13.0 


Cardiac, tonsils 


37 


13.0 


Tonsils, glands 


38 


12.0 


Disease of eye, teeth, tonsils, discharging ear 


39 


10.0 


Cardiac, pulmonary, vision, teeth, hearing 


40 


8.0 


Tonsils 
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TABLE nr. 


SUMMARY 






In Group with 
Highest Scores 


In Group with 
Lowest Scores 


Total number of deferts 


27 

0.71 
52.5 


125 


Average number of defects per student . . . 
Percent having no defects 


3.41 








this boy's showing in the test, and thinking that physical condi- 
tion might bear some relation to defects, we put tiie list of forty 
students with best scores and the list of forty students with poorest 
scores into the hands of our school nurse with instructions to give 
us the health card of every student. The records are given above . 

It was noticeable that the defects among the ablest group 
were not only fewer in number but also less serious in character. 
Some of them, indeed, were only temporary. Most of the defects 
among both groups are entirely remediable. 

In Figure 1 details are shown as to the existence of each de- 
fect in the groups having highest and lowest scores. Of the fifteen 
defects only one occurred oftener among the students having 
the highest scores. This was due to a single case of defective 
hearing which was found in a girl belonging to the high group. 
Of course, this case has no significance whatever beside such 
facts as these: that 60 percent of the low group had defective 
tonsils compared with 10 percent for the high group; that 45 
percent of the low group had defective teeth compared with 17 
percent for the high group; etc. 

Although the number of cases is small, the investigation adds 
something to the accumulating evidence that the child of good 
intellectual ability is also of good physical ability. In other 
words, it supports the view that the gifted child is not likely to 
be the physical and nervous wreck that some have supposed. 
It also contributes to the growing conviction that good abilities 
may be and often are masked through the presence of physical 
defects. And it points to the unmistakable duty of the school 
to provide for every child early and frequent medical inspection 
with a systematic follow-up in applying remedies. 
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PIGDOE 1. PKOPOETION OP DEFECTS AMONG THE FOETY PnPILS 
HAVING THE HIGBEST AND LOWEST INTELLIGENCE SCOSES 
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A STATE-WIDE SCHOOL-BUILDING SURVEY 

George Drayton Strayer 
Teachers^ CoUegty Columbia University 

State control of school buildings has been exercised in the 
United States in some degree by having the plans for new buildings 
passed upon by the state architect or by some special officer in 
the state department of education. Laws have also been enacted 
which require inspection and approval by the state department 
of education when repairs exceeding a minimum amount are 
undertaken. This control has helped over a period of years to 
develop a somewhat better type of building as the population has 
increased and as new buildings have been needed. There has 
been little or no control, however, over buildings which were 
already in use and which were not reconstructed so as to come 
under the provisions of the law. 

Throughout the United States there are today thousands of 
school buildings which are unfit for use, and in many cases dan- 
gerous in the extreme because of the unhygienic conditions or 
fire risks involved. There is need throughout the country for 
state-wide school-building surveys which will reveal the condi- 
tions and which will arouse the public to the need of well- 
considered school-building programs. 

The state of Delaware is the first to undertake this particular 
type of survey. Through the generosity of Mr. Pierre S. du Pont, 
the state has been provided with a fund for the construction of 
its school buildings. In every case the local community is to 
provide funds equal to or more than those provided by the 
du Pont fund, except in the case of schools for colored children, where 
the whole cost will be borne by those administering Mr. du Pont's 
gift. In order to know definitely the condition of school buildings 
throughout the state, Mr. du Pont employed the writer and his 
colleagues to make a school-building survey of all of the school- 
houses in the state outside of the city of Wilmington.* Every 

^ Strayer, George D., Engelhardt, N. L., and Hart, F. W. General report on 
school buildings and grounds of Delaware. (Bulletin of the Service Citizens of Dela- 
ware, V. 1, no. 3). Wilmington, Delaware: Service Citizens of Delaware, 1919. 
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one of these school buildings was visited by one or more of the 
survey commission and rated with respect to site, building, 
service systems, classrooms, and special rooms. Each of these 
main divisions of the score is made up of certain subdivisions 
appearing upon a score card which permits of a maximum of one 
thousand points for a perfect building.* 

Included under site are location, drainage, size and form, and 
flagpole. Under building are included placement, gross structure, 
and internal structure. Under service systems are included heating 
and ventilation, fire protection, cleaning system, artificial lighting, 
schedule and emergency equipment, water supply system, and 
toilet systems. Under classrooms are included arrangement, 
construction and finish, illimiination, cloakrooms and wardrobes, 
and equipment. Under special rooms are included rooms for 
general use, such as playroom, community room, library, and 
lunch room; oflScials' consultation room, and other special service 
rooms (e.g., those for industrial arts and household arts), fuel 
room, storage room, and the like. Each of these subdivisions is 
again analyzed so as to indicate the detail which one needs in 
scoring a school building. Accompanying the score card is a 
set of standards which has been worked out with the cooperation 
of a large number of persons interested in educational adminis- 
tration, in school architecture, and in schoolhouse construction. 

The astonishing thing revealed by the survey in Delaware is 
the almost complete lack of suitable buildings and equipment 
throughout the state. This is particularly true with respect to 
the village and rural schools — i.e., the schools having one to four 
teachers. If one accepts four hundred points out of a thousand 
as the minimum score for a building that is to be permitted to 
continue in use, there are, of the school buildings of more than 
four teachers, just seven buildings in the state, outside of Wil- 
mington, which should be left standing. The following table 
gives the scores for these buildings. 

An analysis of the partial scores allowed establishes the fact 
that these low scores do not depend upon a failure to provide any 

' Strayer and Engelhardt Score Card for City School Buildings and Score Card for 
One to Four-Teacher School Buildings. Published by the Bureau of Publications, 
Teachers* College, Columbia University, New York City. 
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one demait that goes to make up a satistactwy building, 
rather, that the buildings are unfit for use, r^ardless of th< 
ticular standard ai^ed. 



TABLE L SCORES FOR CITY SCHOOL BUHDIXGS OF MORE THAN 

FOUR TEACHERS 



(Arranged in Order of Rank) 



Scores of 




Buildmgs 




850-899 


AW I. da Foot 


800-849 


Caesar Rodney 


750-799 


(None) 


700-749 


w 


650-699 


M 


600-619 


HarriDgtoQ 


550-599 


BridgevOk 


500-549 


Greenwood 


450-499 


Fredenca, Mt. Pkasant 


400-449 


(None) 


350-399 


Refaoboth, Newark Grammar. Dover 


300-349 


ShdbyviDc, Milford, Lewes, Miltoii, 




Georgetown, Smyrna, Middletown, 




New Castle Elementary, Seafoid, 




Ddawareaty 


250-299 


Fdton, Laurd, Ddmar 


200-249 


Newark Academy, Mfflsboio, 




Frankford 


150-199 


Clayton, New Castle Academy, 




DagsbOTO 



The rural schools, however, show even more deplorable con- 
ditions; and since school surveys have generally treated of dty 
school buildings, it seems best to analyze the situation in detail 
for these rural commimities. Only schools for white children will 
be considered. In Table 11 are given the scores assigned to each 
of the two hundred and ninety-three village and rural schools for 
such children — to the schools, in other words, having one to four 
teachers. 
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TABLE n. SCORES FOR ONE- TO FOUR-TEACHER SCHOOLS 

FOR WHITE CHILDREN 

(Maximum Possible Score, 1,000) 



Scores of 


No. of 


Buildings 


Buildings 


0-49 





50-99 


1 


100-149 


6 


150-199 


21 


200-249 


72 


250-299 


90 


300-349 


49 


350-399 


31 


400-449 


15 


450-499 


5 


500-549 


2 


550-599 





600-649 





650-699 


1 


Total 


293 


25-percentile 


230.77 


Median 


275.00 


75-perccntilc 


329.35 



This table reads as follows: one building scored between 50 
and 99 points, and six buildings scored between 100 and 149 
points. As is indicated at the bottom of the column headed 
^'Number of Buildings," one quarter of the whole number of 
buildings scored less than 231 points, one-half of them less than 
275 points, and three-quarters of them less than 330 points. 

An analysis of the scores given to these schools with respect to 
site, building, service systems, classrooms, and special rooms will 
make clear the need for the reconstruction of nearly all of these 
buildings on a new site. 

With reference to site, it will be observed that, according to 
Table III, one-half of the buildings scored less than 66 points out 
of a possible 160. Stated in terms of the actual situation, it may 
be said that the typical school site in Delaware is a piece of 
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ground, triangular or rectangular in form, with an area of less 
than one-half an acre, in the angle of a crossroads. It is ordinarily 
not considered suitable for cultivation; and it is not infrequently 
so low as to make it difficult or impossible to drain it properly. 
In a great many cases this little plot of ground is either in a densely 
wooded section or on the edge of a forest or swamp. Village and 
rural schools in Delaware need larger and better school sites. 
Playgrounds, play apparatus, and teachers who can teach children 
how to play, are needed throughout the state. The survey 
has revealed the need, and the people will, it is hoped, provide 
the sites. 



TABLE in. SCORES FOR ONE- TO FOUR-TEACHER 
SCHOOLS FOR WHITE CHILDREN WITH 
RESPECT TO SCHOOL SITE 

(Maximum Possible Score, 160) 



Scores 


No. of 




Buildings 


0- 9 





10- 19 


2 


20-29 


7 


30-39 


20 


40-49 


19 


50- 59 


38 


60-69 


63 


70- 79 


37 


80-89 


40 


90- 99 


31 


100-109 


16 


110-119 


14 


120-129 


3 


130-139 


3 


Total 


293 


25-percentile 


55.32 


Median 


66.00 


75-percentile 


86.75 
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A maxiiniim possible score of 200 points is allowed for the 
building, as such, including its placement on the site, its gross 
structure, and its internal structure. Gross structure includes 
the type of building, material used, height, roof, foundation, 
walls, entrances, and the like. Internal structure includes stair- 
ways, vestibules, corridors, basement, color scheme, and the 
like. The scores for these elements are indicated in Table IV. 



TABLE IV. SCORES FOR ONE- TO FOUR-TEACHER SCHOOLS 

FOR WHITE CHILDREN WITH RESPECT TO 

GROSS STRUCTURE OF BUILDING 

(Maximum Possible Score, 200) 



Scores 


No. of 




Buildings 


0- 9 





10- 19 


3 


20- 29 


4 


30-39 


21 


40-49 


38 


50- 59 


59 


60-69 


60 


70- 79 


48 


80-89 


19 


90-99 


14 


100-109 


12 


110-119 


6 


120-129 


5 


130-139 


2 


140-149 


1 


150-159 





160-169 


1 


Total 


293 


25-percentilc 


50.23 


Median 


62.66 


75-percentile 


76.09 



It will be observed by reading this table that one-half of the 
buildings scored less than 63 points out of a total of 200. Most 
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of the bufldings in Delaware are very old frame, stone, or biidc 
structures, that have outlived their usefulness. The tyfMcal 
building is a most unattractive, store-box type of structure, with 
windows located at regular intervals on two or three sides, with 
the entrance on the fourth side. In almost no case is there any 
evidence of an attempt to make the school building attractive 
architecturally. In many of these buildings there is not even a 
vestibule. In more than half of them no cloakroom is provided. 
In many instances the roof, sadly in need of repair, has permitted 
enough water to enter the building to damage the plaster, even 
to the point of causing a large part of it to fall off the ceiling and 
walls. In some cases a leaking roof has resulted in a moldy 
interior, totally unht for school purposes. Floors are badly 
damaged, books are moldy, and school furniture is discolored and 
covered with dirt on accoimt of a failure to provide adequate 
protection against the rain. 

The most striking failure to provide adequately for these 
school children is revealed in the scores which were allowed for 
service systems. When one remembers that this includes heating 
and ventilation, fire protection, cleaning, artificial lighting, water 
supply system, and toilets, it is easy to imderstand what a very 
low score means. 

From Table V it will be observed that one-half of the school 
buildings received a score of less than 55 points out of a possible 
250. More than half of these buildings had no source of heat 
other than the old-fashioned stove placed in the middle of the 
room. Only three buildings were provided with inside toilets. 
The toilets placed on the school grounds were almost uniformly 
in a most imsanitary condition, and were very generally marked 
with obscene pictures and writing. If the children of the state 
are to be properly cared for and freed from the contaminating 
influence of the outhouses now found everywhere on the grounds, 
toilet rooms on the same floor as the classrooms, with sewer 
connections, sewage disposal, or mechanical toilet tank, should 
be installed. In the buildings which are to be constructed a 
modem form of jacketed stove should be provided; or, if the 
consolidations proposed by the survey commission are made, 
heating^plants in the basement^should be^installed. 
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TABLE V. SCORES FOR ONE- TO FOUR-TEACHER 
SCHOOLS FOR WHITE CHILDREN WITH RESPECT 

TO SERVICE SYSTEMS 

(Maxiinum Possible Score, 250) 



Scores 


No. of 




Buildings 


0- 9 





10- 19 


2 


20- 29 


17 


30-39 


48 


40-49 


52 


50-59 


50 


60-69 


71 


70- 79 


31 


80- 89 


13 


90-99 


5 


100-109 


3 


110-119 





120-129 





130-139 





140-149 





150-159 





160-169 





170-179 





180-189 





190-199 


1 


Total 


293 


25-percentile 


40.18 


Median 


54.50 


75-percentile 


66.24 



Space devoted to classroom use is allowed a score of 225 
points out of a thousand. Under this head are included the size 
and form of the classroom, its floors, walls, ceiling, and their 
condition, the lighting of the room, the furniture, the cloakroom 
and wardrobes adjacent to or included in the classroom, black- 
boards, pictures, and teaching equipment. 
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VL SCOKES FOK OXE- TO FOUR-TEACHER 
SCHOOLS FOE WHUE CHILDEEX VHH RESPECT 

TO CLASSROOMS 

(Mazimmn Possibk Score, 225) 



No. of 



0- 9 





lO- 19 





20-29 





50- 59 


1 


40- 49 


3 


50-59 


U 


60-69 


31 


70-79 


40 


80-89 


47 


90-99 


69 


100-109 


50 


110-119 


15 


120-129 


17 


130-159 


11 


140-149 


5 


150-159 


5 


160-169 


1 


170-179 


2 


180-189 


1 



Total 


293 


25-peicentfle 

Median 


74.75 
90.34 


75-percentile 


103.82 



It will be observed from reading Table VI that one-half of 
the schools were scored less than 90 points out of a possible 225. 
This is due to the fact that in most cases the classroom was not 
sufficient in size, that in many cases the floor, walls, and ceiling 
were in miserable condition, that the lighting of the room was 
very seldom satisfactory, that the furniture was often of a very 
old type and seldom of a sufficient number of sizes to accom- 
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modate the children of the different age groups, and that in 
general there was a most remarkable absence of pictures, charts, 
globes, or other teaching equipment. 

In order to conduct a modem school, rooms other than class- 
rooms must be provided. One hundred and sixty-five points 
are allowed on the score card for special rooms, under which 
head are classified playroom, community room, oj£cials' consulta- 
tion room, library, lunch room, space for industrial and household 
arts, and fuel room. It is the contention of the survey commis- 
sion that no one-room school provides the space necessary for 
the education of children of the varying ages found in a rural 
school. The scores for special rooms appear in Table VII. 



TABLE Vn. SCORES FOR ONE- TO FOUR-TEACHER 
SCHOOLS FOR WHITE CHILDREN WITH RESPECT 

TO SPECIAL ROOMS 

(Maximum Possible Score, 165) 



Scores 


No. of 
Buildings 


> 





33 




1 


27 




2 


103 




3 


92 




4 


13 





5 

6 

7 

8 

9 

10-19 

20-29 

30-39 

40-49 


11 
1 
2 

1 
2 
4 
1 
3 


Total 


293 


25-percentile 

Median 


1.12 
1.84 


75-percentile 


2.60 
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The reading of the table indicates that a very mininiiim of 
such equipment has been provided for the one- to four-teacher 
schools of Delaware. Only 14 buildings out of the 293 rural 
schools for white children received more than 5 points out of a 
possible 165. 

Certain other interesting facts with respect to these buildings 
are indicated in Table VIII. From this table it will be observed 
that 45 percent of the buildings are located on a triangular or 
irregular site, that 30 percent of them are without vestibuleiSi 
and so on for the other items. 

TABLE Vin. NUMBER AND PERCENT OF BUILDINGS 
WITH SPECIFIED DEFECTS AND FACILITIES 

No. of 
Buildings Percent 

Located on triangular or irregular site 131 45 .0 

Without vestibule 87 30.0 

No water supply 81 28.0 

Without improved type of heater 134 45 . 7 

Without flagpole 120 41 .0 

Without cloakrooms 183 62.5 

Low in glass area 144 49.1 

Light from 1 side 

" 2Mde8 165 56.3 

" 3 sides 102 35.0 

" 4 sides 15 5.1 

" 5 sides 

" 6 sides 1 0.3 

" 7 sides 1 0.3 

With gas or electricity 4 1.4 

With indoor toilets 3 1.0 

With playroom 4 1 .4 

With community room 5 1.7 

With office 1 0.3 

With industrial arts 

With household arts 

With Ubrary 1 0.3 

With lunch room 1 0.3 

A similar set of tables of scores for the buildings used by the 
colored children of the state would indicate an even more deplora- 
ble situation than that revealed in the analysis of the provisions 
made for the white children. 
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The hopeful part of the entire situation for Delaware, how- 
ever, is to be found in the generosity of Mr. du Pont and in the 
action already taken by a great many communities to abandon 
the buildings which are unfit for use and to construct modern 
schools buildings on adequate sites. These new buildings will 
cost more than has heretofore been expended on school buildings 
in the state of Delaware. If the recommendations of the survey 
commission are followed, the number of one-teacher schools will 
be diminished very rapidly on account of the consolidations which 
will be effected. There may remain a very few one-teacher 
schools, but even in these remote communities adequate facilities 
should be provided, even though the cost be greater; and un- 
usually capable teachers should be provided for them, even though 
it may be necessary to pay a larger salary than is ordinarily paid 
to those who teach in the towns and cities of the state. 

A similar survey of the school buildings of other states might 
show either a better or a worse condition. It can be confidently 
stated, however, that any such survey would make clear the 
necessity for the development of a state-wide school-building 
program such as has been undertaken in no state except Delaware. 






A SHORTER METHOD FOR COMPUTING 
THE COEFFICIENT OF CORRELATION 

Leonard P. Ayres 
Russdl Sage Foundation, New York Ciiy 

The coefficient of correlation measures the agreement between 
two series of numbers. The numbers are in pairs and each num- 
ber in the first series is the first member of a pair of measurements, 
while the corresponding number in the second series is the second 
member of that pair. The object of computing the coefficient 
of correlation is to find in what degree smaller quantities in one 
series imply correspondingly smaller quantities in the other, and 
larger quantities in the one imply correspondingly larger quanti- 
ties in the other. The coefficient of correlation does this by 
comparing the amount of agreement that does exist with the 
perfect agreement that might exist. 

The Pearson Coefficient 

The formula for finding the Pearson coefficient of correlation 
is best expressed as : 

S (x.y) 
f=* — zzr zm 

In this formula: 

f» correlation 

Zs summation 

j(« deviations from the average of the first series 

^rx- deviations from the average of the second series 

The use of the formula may be illustrated by finding the 
correlation between two short and simple series as follows : 

3 6 

4 5 

5 7 
8 11 

10 11 

30 40 

Since there are five numbers in each series, the average of the first 
series is 6, and that of the second is 8. The next step, according 

216 
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to the formula, is the finding of the deviations of these numbers 
away from their averages. Calling these deviations x and y 
they are as follows: 



X 


y 


-3 


-2 


-2 


-3 


-1 


-1 


+2 


+3 


+4 


+3 



It is clear that there is considerable agreement between the general 
trends of these two series. Large minus deviations in the first 
series are accompanied by large minus deviations in the second 
series and large plus deviations in the first by large plus deviations 
in the second. The problem is to find how nearly complete this 
agreement is; how near the partial agreement that does exist 
comes to equaling the perfect agreement that might exist. 

The Actual Deviations 

This involves comparing the actual deviations of these two 
series with those that might be found if the agreement were per- 
fect. The actual deviations are measured by multiplying the 
corresponding members of the two series and getting the sum of 
these products as follows : 

xy 

+6 

+6 

+1 
+6 

+12 



31 

Deviations for Perfect Agreement 

The next step is to find a measure of the deviations that would 
exist if the agreement between the two series were perfect. The 
first deviation of the x series is —3 and the second is —2. If the 
corresponding deviations of the second series were identical 
they would also be —3 and —2 and there would be perfect 
agreement. 

Following the method already used in measuring the actual 
deviations, a measurement may be found for the deviations that 
would exist if all those of the second series were equal to those 
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in the first. This is done by multiplying all these deviations of 
the first series by themselves or finding their squares. The same 
process is now carried through with the second series and the 
squares of both series of deviations are the following : 

x« >• 

9 4 

4 9 

1 1 

4 9 

16 9 

34 32 

We now have three quantities: 31 which measures the actual 
deviations of the two series, 34 which shows what the deviations 
of the X series would amount to if they were accompanied by 
identical deviations in the y series, and 32 which shows what 
those of the y series would amount to if they were accompanied 
by identical deviations in the x series. 

Comparing the Actual with the Possible 
The actual deviations must now be compared with those that 
might exist if the correlation were perfect. This is done by 
comparing 31 with 34 and 32 simultaneously and, since 34 and 32 
are the sums of series of squares, the comparison is made by find- 
ing the product of their square roots and comparing 31 with that 
number. This working out of the formula gives the following: 

2J*.y 31 31 ^ ^^ 

f- — ^Z"'^"Z: Z*" =0.94 

VZ:^ V 2/ 1/34 1/32 32.98 

The work described is easy in the artificially simple example 
chosen but far more laborious in cases where the average is not a 
whole number, for this involves multiplying and squaring with 
numbers having decimal fractions. There are methods for doing 
this that involve finding the deviations from a whole number 
near to the average and then correcting the work to allow for the 
differences between the results so found and the correct results. 
These methods are laborious and increase the chances of letting 
errors of computation destroy the accuracy of the work. 

A Shorter Method 
All these difficulties may be avoided by a method which it is 
the object of this article to present, and which gives the sums of 
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the products and the sums of the squares of the deviations directly 
from the squares of the original numbers. It does not involve 
arranging the series in order, or finding the separate deviations, 
and so avoids the necessity for taking into account the plus and 
minus signs of deviations. 

This method is based on considering every nimiber in a series 
as being equal to the average of the series plus a plus or minus 
deviation from that average. Thus 10, which is the last number 
in the first series of the illustrative example already cited, may be 
considered as being equal to the average of the series, or 6, plus 
the deviation 4. 

If now we find the sum of the squares of the numbers in a 
series and subtract from it the product found by multiplying the 
square of the average of the series by the number of cases, the 
remainder will be the sum of the squares of the deviations from 
the average. Suppose, for example, that the series consists of 
the two numbers 4 and 8. Their average is 6 and the deviations 
from it are — 2 and +2, the sum of the squares of which equals 8. 
But it is also true that the squares of these nimibers are 16 and 64 
with a sum of 80. If we subtract from this the square of the 
average, or 36, multiplied by the number of cases, or 2, we again 
get 8 as a result. 

The Formula 

Utilizing this principle we may compute coefficients of correla- 
tion directly from the products and squares of the items of the 
two series without finding the separate deviations. Before writing 
the formula certain abbreviations may be set down as follows: 

Sub. s the fiirst, or subject series 

Rel.=the second, or relative series 

Tot. = the total of a series, the sum of its items 

Av. s the average of a series 

The formula expressed in these abbreviations, and also using 
the letters S and R for subject and relative, is as follows : 

Sum of products of subject and relative items 

minus 
av. of subject items X tot. of relative items 

fa 

Sum of squares of sub. items Sum of squares of rel. items 

minus y\ minus 

av. X total of these items av. X total of these items 
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It may be more easily written but perhaps less easily remembered 
if expressed as follows : 

zs.R 

N 



f=- 




SS« 



(25)1 



N 



21P 



N 



Thfe application of this formula to the example already worked 
by the conventional method is as follows : 



Sub. 


Rel. 


Sub.« 


Rel.« 


Sub. X 


3 


6 


9 


36 


18 


4 


5 


16 


25 


20 


5 


7 


25 


49 


35 


8 


11 


64 


121 


88 


10 


11 


100 


121 


110 



214 



352 




Total 30 40 

Average 6 8 

Fu:st correction=271-(6X40)=271-240=31 

Second correction =2 14 -(3X60) =2 14 -180 =34 

Tliiid correction=352-(8X40)=352-320«32 



271 



31 



31 



f= 



0.94 



1^34x32 32.98 



An important feature of this method is that it facilitates 

<J the use of mechanical aids to computation. The work consists 

r* almost entirely of taking squares from tables and multiplying and 

adding, which are the operations most easily done by machines. 

It eliminates the long series of subtractions which are not readily 

done by the help of machines. It also eliminates the necessity 

for watching for unlike signs in the multiplication of deviations, 

and making the series of corrections to allow for the differences 

between the guessed averages and the true averages of the series. 

Experience in using this formula in dealing with the problems 

arising in the regular work of a statistical office indicates that it 

reduces by something more than one-half the time necessary to 

compute correlations from short series of 20 or 30 pairs of items. 

On longer series the saving is greater and on distribution tables 

involving some thousands of cases, grouped in about 100 compart- 
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ments, it cuts the time to one-third or one-fourth of that required 
by the old methods. Ahnost more important is the fact that its 
use very greatly reduces the number of errors made in working 
out the computations. 

The use of the theorem that the sum of the squares of the 
deviations of a series of items away from their average is equal 
to the sum of the squares of the items minus the product of the 
total of the series and its average will greatly facilitate the finding 
of the standard deviation. Those who are interested in seeking 
a further explanation of the theorem itself will find it in consider- 
ing each item of the series as a binomial consisting of the average 
plus a plus or minus deviation from the average. By squaring a 
series of such binomials and adding them, it will be found that 
the middle terms cancel out, leaving the squares of the average 
and the squares of the deviations. A similar procedure in mul- 
tiplying the items of the two paired series will explain the process 
followed in deriving the numerator of the fraction given in the 
new formula. 



TEXTBOOKS: THEIR COST AND IMPROVEMENT 

It is generally agreed that the results, the methods, and the 
spirit of research ought to be evident in school practice. As 
long as they are confined to remote laboratories and described 
in technical treatises, they merely exist in a vacuum. We, there- 
fore, seek to bring them to the attention of those who supervise 
and teach. But this is not sufficient. The practice of teachers is 
largely controlled by the textbook. As is frequently pointed out, 
it plays a unique part in the affairs of the American school. It is, 
therefore, highly important that the textbook should exemplify 
the best that competent research has established. There should 
be an easy transfer of the findings of investigators to the content 
of schoolbooks. It is not enough to train the teacher in the spirit 
of research; the textbook should be the concrete fruition of 
research. 

r : This is not often true. Constant revision of existing texts and 
frequent publication of new ones can only be accomplished if 
boards of education set aside considerably more money for books 
than they now do. There must not only be a larger fund for 
teachers' salaries, but there must also be a larger textbook fund. 
In fact, the whole scheme of universal public education can no 
longer be effectively maintained without going to new and higher 
cost levels. 

Expenditures for textbooks in this country are very small, 
considering their importance in the teaching process. They cost 
rather more than perfumery and cosmetics and rather less than 
chewing gum. In 1913, the aggregate of sales for elementary and 
high-school use was a little over $14,000,000. This amounted to 
78 cents for each child enrolled in the public schools, to 57 cents 
for each child on the census rolls, and to somewhat less than 15 
cents per capita of the population. Doubtless, the figures are a 
little higher now, but we all know that due to long-time contracts, 
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the cost of textbooks has been held down. At any rate, these 
figures are of such an order of magnitude that no change which 
could possibly have taken place in the last six or seven years would 
make any material difference in our argument. Average condi- 
tions for 1914 in 21 states showed that if every pupil who entered 
the first grade remained through the eighth grade, a complete 
layout of new basic textbooks for his eight-year course would cost 
but $9.40. It is said that we are an extravagant people, that we 
are passing through a period of wild expenditure; but here is a 
place where our frugal nature apparently asserts itself. In the 
midst of the riotous living in which everyone except school teachers 
is supposed to be indulging, we are spending 15 cents a piece — 
or may it be 25 cents? — for the instruments of instruction with 
which we equip our schools. 

It is not generally known, however, that our expenditures for 
this purpose are so meager. Exaggerated ideas on this subject 
seem to persist. In Illinois, for example, in 1912 wide publicity 
was given to an estimate that in that state the textbook profit 
amounted to $1,000,000 per year. As a matter of fact, the total 
annual volume of business in Illinois was at that time only about 
$750,000. Again, in connection with the political handling of 
the textbook question in Kansas a few years ago, wild estimates 
of what might be "saved to the tax payers" were made — estimates 
which sometimes exceeded the value of all the books sold in that 
state. 

As a matter of fact, the cost of textbooks is so small that the 
real problem is not to cheapen them but to improve them and to 
increase the number available for each child. To do this we shall 
need to spend much more. Perhaps instead of remaining on the 
chewing gum basis, we shall have to lay out as much as we spend 
for soda water. For publishers cannot afford to incorporate new 
and better features into their books because the price of textbooks 
has been "standardized." Boards of education are willing to pay 
only about 32 cents for a speller, 90 cents for a history, or $1.00 
for a geography. With the introduction of free textbooks and 
the utilization of the large purchasing power of state, municipal, 
and county governments, this pseudo-standardization has been 
brought about — a condition whereby a speller is a speller and a 
history a history no matter what their covers may contain. 
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Investigations looking toward the improvement of textbooks 
are under way in a number of places and it is certain that this 
type of investigation will become more prevalent when its impor- 
tance is better understood. Titles of recent masters' and doctors' 
theses make clear the fact that in departments of education in 
collies and universities, the two fields of research which are 
regarded as most significant are the study of teachng methods and 
the analysis of curriculums. In the public schools, however, it is 
equally dear that the teaching methods and curriculum actually 
put into practice are the methods and curriculum of the textbook. 
To be effective, therefore, it is in the textbooks that the new 
methods and curriculums must be expressed. 

It has been pointed out that three financial obstacles stand 
in the way: an inverted sense of values, an exaggerated notion of 
textbook costs, and a wrong-headed idea of eJ05ciency. The 
inverted sense of values is evident in our vast expenditures for 
trumpery while we each contribute the price of a movie ticket 
that twenty million pupils may have the benefit of the most 
effective instruments of instruction. The exaggerated notion of 
costs is locally present wherever textbooks instead of being pro- 
vided at public expense are purchased by parents; and the notion 
has also become generally current because of political rodomon- 
tade and reports (true and false) of crooked adoptions. The 
wrong-headed idea of efficiency is due to lay purchasing agents 
whose aim is to make a financial record and who judge the value 
of a book not by its contents but by the class to which it belongs. 

For these reasons, although we are in the midst of researches 
whose results ought to be at once reflected in better textbooks, 
better textbooks are slow to appear. If it is a day of promise in 
research, it is also a day of stagnation in textbook making. The 
results, the methods, and the spirit of research will never become 
fully applicable in the work of the schools until in addition to their 
apprehension by teachers, they find expression in the books whch 
are placed in the hands of pupils. 

S* R.. £• 




Strayes, George D., Engelhardt, N. L., and Hart, F. W. General 
report an buildings and grounds of Delaware, Wilmington, Delaware: 
Service Citizens of Delaware, 1919. 222 pp. 

One or more of the authors of the report visited every school house in 
Delaware, rated it by means of the well-known Strayer score card for school 
buildings, made observations concerning those features of each building to 
which they thought the attention of the people concerned should be called, 
and submitted a complete report to the Service Citizens of Delaware. The 
printed report gives representative cases for each type of building. Concern- 
ing each case reported there appear, first, the comments concerning the 
special needs of the particular building; second, the scores given the building 
on (a) site, (b) building, (c) service systems, (d) classrooms, and (e) special 
rooms; and third, in most cases a photograph. Chapter I contains a rather 
full statement of the characteristics of a modem school building. Part II 
gives a series of definitions of so-called minimum standards for each aspect 
of a school building listed on the score card, and tables of distribution of 
Delaware's buildings by coimties according to scores on each of the main 
headings. 

To the general reader residing outside of Delaware, the most significant 
part of the report is Chapter I. In it is given a brief but complete description 
of the essentials of a modern school building. The language is simple and 
direct. This splendid summary of modern requirements in school buildings 
should prove of great value to school boards as well as to superintendents 
at any time; but it is particularly timely just now when so many conmiunities 
of all types are inaugurating school building programs. These modem 
requirements are naturally far in advance of actual building conditions not 
only in Delaware but also, no doubt, in all other states. Nevertheless, some 
buildings in Delaware are found to measure up well with these requirements, 
and there is a delightful assumption on the part of the authors that all the 
districts of Delaware will naturally wish to reach these high standards when 
they are made aware of them. 

To the student of education there is much food for thought in Part II. 
The attempt to define minimum standards with respect to each subhead 
appearing on the score card brings out both the utility and the difficulty of 
such an undertaking. The authors have met the problem of difference in 
judgment which is bound to arise in respect to many of the standards by 
adopting the term "Optional" for many of the most debatable essentials. 
For example, imder "Seats and Desks," they give as minimum, "Should be 
individual, adjustable, and adjusted," but they add as optional, "Movable 
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chairs are preferable to screwed-down seats." In spite of the inevitable 
differences of opinion concerning the definitions of these minimum standards, 
the well-classified and carefully worded definitions will prove very helpful 
indeed as a practical guide. 

The genuine value of a score card as a method of evaluating buildings is 
dearly brought out in the distribution tables. Here we see a figure standing 
for the total score of a building, just as a figure stands for the score of a 
thoroughbred animal. One buildiog can be compared with another, either 
as a building or in respect to any of its aspects. Comparison can also be 
made between the whole set of Delaware buildings and any other group of 
buildings measured by the same score card. Probably no other method of 
stating building facts could have been as effective in bringing the state to a 
realization of the seriousness of its building situation. 

The chapters dealing with the individual buildings should prove of 
great value to the districts concerned. Even though the situation revealed 
is often deplorable, the account is only rarely couched in terms of rebuke. 
The several districts cannot help feeling that the survey was made for a con- 
structive purpose, and will imdoubtedly utilize many of the suggestions in 
constructing new buildings. 

F. J. K. 

Obrien, Francis P. The high school failures. (Teachers College 
Contributions to Education, No. 102.) New York: Teachers College, 
Columbia University, 1919. 97 pp. 

The free public high school enrolls about 85 percent of all the secondary 
school pupils in the United States. That fact alone makes appropriate a 
study of the products in terms of success or failure in attaining the standards 
set by particular schools. This book is such a study. In it the author 
analyzes the cumulative records of 6,141 pupils in eight different high schools 
in New York and New Jersey, in order to determine the significant facts 
relative to pupils who fail. For this group of pupils he has answered defi- 
nitely and conclusively these questions which are stated as chapter headings: 

'How extensive are the failures of the high school pupils?" 

'What basis is discoverable for a prognosis of the occurrence or the 
number of failures?" 

''How much is graduation or the persistence in school conditioned by 
the occurrence or by the number of failures?" 

''Are the school agencies employed in remedying the failures adequate 
for the purpose?" 

"Do the failures represent a lack of capability or of fitness for high 
school work on the part of those pupils?" 

"What treatment is suggested by the diagnosis of the facts of failure?" 

Some of the more important findings are: 

1. The percent of recorded and virtual but unrecorded failures is 66. 

2. Of the graduating pupils 58. 1 percent fail one or more times. 

3. The number of failures increases for the first four semesters, with 
one-third to one-half of the pupils failing in each semester to the seventh. 
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4. Of all the failures 86 percent occur for pupils from 15 to 18 years of 
age, inclusive. 

5. Mathematics, Latin, and English combined furnish 60 percent of the 
total failures, but English furnishes many rather because of large enrollment 
than because of difficulty. The percent of failures of pupils taking the 
subject is greatest for mathematics, Latin, and German. ^ 

6. The younger entering pupils have fewer failures and are more certain 2 

of graduation. * / 

7. The first year's record has real prognostic value for pupils who remain ^ / 
in school more than three semesters. 

8. As many graduates as non-graduates fail — 31 . 5 percent in each case. 

9. "Failure is probably not a prime cause of dropping out for most of 
the non-graduates, as 80 percent have only five failures or fewer." (p. 58) 

10. ''The worst consequences of failure are perhaps in acquiring the 
habit of failing and in coming to accept oneself as a failure." (p. 58) 

11. "The emphasis placed on repetition is excessive and the faith dis- 
played in it by school practice is imwarranted by the facts." (p. 74) 

12. The number of pupils who lack native ability is small. ^» 
Thus the author does not regard lack of intellectual ability as being a 

particularly potent cause of failure. He rightly points out that the pupil is 
only one of the factors contributing to failure. His emphasis in the matter 
of obviating failure is placed upon subject matter and the aims of teaching. 

In a sense the author is right. From the very nature of the case, as 
Burk points out, there can be no misfit children. There may be misfit 
courses of study, misfit teachers, or a misfit educational philosophy, but 
there can be no misfit child because all these must be fitted to the child. 
As well say that a person does not fit his clothes as to say that a child does 
not fit the school. 

On the other hand, one should point out that the trend of thought today 
is in the direction of emphasizing intelligence as an important cause of 
failure and of leaving school. Professor Terman and his students are bring- 
ing to bear a large amoimt of data on this question. They are doing so by 
actually administering intelligence tests to the children who fail as well as to 
those who do not. One may point out that Dr. Obrien's conclusion that 
failing pupils "lack neither ability nor earnestness" is not based on evidence 
as direct and convincing as is the evidence gathered from actual testing for 
intelligence. 

As remedies for failure. Dr. Obrien suggests, among other things: a 
functioning psychology; whole-hearted purposeful responses from the pupil; 
properly selected student advisors; a high degree of flexibility in the curricu- 
lum; the reduction of subject matter to smaller imits; provision for directed 
study; and the collection and interpretation of useful facts. Some of these 
suggestions are important, others are rather naive; and all are more or less 
without foimdation in evidence. 

As needed analyses of this kind are made and the imescapable facts of 
failure are produced, the important question for secondary education is to 
determine what is to be done about it. Is the high school to be a selective 
institution for the purpose of educating the leaders of society? Or is it to 
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be an institution where every youth who can profit from secondary instruc- 
tion is enrolled? Just now we are at the parting of the ways with the tradi- 
tional sign post pointing to a continuance of absolute uniformity. The new 
re-interpreted social theory demands that each individual shall live as fully 
as we know how to permit him. In practice, therefore, curriculums must l>e 
devised so as to find out the interests, ideals, abilities, and even the prejudices 
of pupilsf and then provision must be made for the full development of 
interests, ideals, and abilities. 

P. E. Belting 
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A BIBUOGRAPHY OF STANDARIZED TESTS FOR THE 

HIGH SCHOOL 

Walter S. Monroe 

Assistant Director, Bureau of Educational Research, University of Illinois 

(Continued from February Number) 

rv. English 

A. Composition 

Hanrard-Newton Composition Scale. The Harvard-Newton Composition Scale 
consists of four separate scales, one for each form of discourse: argumentation, 
description, exposition, and narration. Each of the scales consist of six composi- 
tions written by eighth-grade pupils and arranged in order of merit as' determined 
by the marks assigned by teachers, rating them as eighth-grade compositions. 
This scale has been used in the first-year classes in the high school. 
Publisher: Harvard University Press, Cambridge, Massachusetts. 
References: Ballou, F. W. Scales for the measurement of English composition. 
(Harvard Newton Bulletin No. 2) Cambridge, Massachusetts: Harvard 
University Press, 1914. 

The derivation and uae of the scale is described. 

Stoddard, W. £. "Comparison of the Hillegas and Harvard-Newton scales in 
English composition," Pedagogical Seminary, 23:498-501, December 1916. 

Second annual conference on educational measurements, April, 1915, p. 115 ff. 
(Indiana University Bulletin, v. 13, no. 11, October, 1915). 

An account of the use of this scale in the first year of the high school is given. 

Hillegas' Scale for the Measurement of the Quality in English Composition for Toong 
People. This scale consists of ten compositions ranging from an artificial pro- 
duction, whose scale value is zero, to the tenth composition, whose scale value is 
9.3. Three of the ten compositions are artificial productions, five were written 
by high school pupils, and the remaining two by college freshmen. No two were 

« 

written on the same topic and they vary greatly in length and type. Each degree 

of merit is represented by only one composition. 

Publisher: Bureau of Publications, Teachers College, Columbia University, 

New York City. 
References: Courtis, S. A, Tthe Gary public schools: measurement of classroom 

products. New York: General Education Board, 1919, p. 227. 

An account of the use of this scale in the high school is given here and also in the following 
reference. 
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An educational survey of JanesviUe^ Wisconsin, Madison, Wisconsin: State De- 
partment of Public Instruction, 1918, p. 287. 

Gunther, Charles. ''My experience with the Hillegas scale," English Journal, 
2:535-42, November 1919. 

Describes a series of experiments carried on by four teachers in the use of the Hillegas scale. 
Mr. Gunther in his conclusion definitely states that through the Hillegas or some similar scale greater 
uniformity is gained than through a percent scale. 

EQllegas, Milo B. ''Hillegas scale for measurement of English composition," 

Teachers College Record, 13 -.331-84, September, 1912.. 
Johnson, F. W. "The Hillegas-Thomdike scale for measuring the quality in 

English composition by young people" School Review, 21 :39-49, January, 1913. 
Kayetz, Isidor. "A critical study of the Hillegas composition scale," Pedagogical 

Seminary, 21:559-77, December, 1914. 

The first part of the article is concerned with the scale itself; the second part devoted to a 
criticism by the author and others. References relative to the scale foUow. 

Parker, F. E. "Value of measurements," English Journal, 8:203-17, April, 1919. 

A criticism on the use of the Hill^as scale by a subcommittee of the Detroit English Qub. 
S. A. Courtis discusses the "Use of the Hillegas Scale" in the second part of this article. 

School report of the town of Souihington, ConnecUcui, 1917, p. 12. 

Stoddard, W. E. "G>mparison of the Hillegas and Harvard Newton scales in 
English composition," Pedagogical Seminary 23:498-501, December, 1916. 
Most valuable for its criticism of the Hillegaa scale. 

Thomdike, E. L. "Notes on the significance and use of the Hillegas Scale for 
measuring the quality of English composition," English Journal, 2 -.551-561, 
November, 1913. 

Minnesota English G>mpo8ition Scale. 

Reference: Van Wagenen, M. J. "The Minnesota English composition scale, its 
derivation and validity." To be published in the first volume of the Journal 
of Educational Researhc. 

Nassau G>nnty Supplement to the Hillegas Scale. This scale is a simplification and 
improvement of the original Hillegas Composition Scale. It consists of a series of 
compositions written under controlled conditions and arranged in order of general 
merit. 

Publisher: Bureau of Publications, Teachers College, Columbia University, New 
York City. Also obtainable from Bureau of Educational Research, Univer- 
sity of Illinois, Urbana, Illinois. 
References: Theisen, W. W. "Improving teachers' estimates of composition 
specimens with the aid of the Trabue Nassau County scale," School and 
Society, 7:143-150, February 2, 1918. 

Discusses the outcomes of an experiment i»ompted by the question: "Can teachers improva 
their judgment of the merit of compositions through use of the scak?" 
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Trabue, M.'R. ''Supplementing the ICllegas composition scale," Teachers CoUege 

Record, 18:51-84, January, 1917. 

Reasons for oonstructing the Nassau County supplement, its advantages over the Hillegas 
scale. Table V lists the "estimates of quality to be expected from high school seniors and sophomores" 
in the use of the Hillegas scale. 

An account of the use of scale in the high school may be found in the following: 

Report of a Survey of Public Education in Nassau County, New York. Albany, 

New York: University of the State of New York, 1918, p. 149 ff. 

Report of a survey of the school system of St, Paul, Minnesota, 1917, p. 456. 

Sa>res are given for St. Paul, Minnesota; Mobile and Mobile County, Alabama; Nassau 
County, and South River, New York; Lead, South Dakota. 

Topeka Scale for Judging G>mpo8ition8. This scale was devised by the English 

department of the high school in Topeka, ELansas. 

Address: Carmie S. Wolfe, High School, Topeka, Kansas. 

Reference: "The Topeka scale for judging compositions,'' Bulletin of the Illinois 

Association of Teachers of English, v. 9 no. 6. March, 1, 1917. 

' Scale reproduced and derivation described. For a copy of the bulletin address Professor H. G. 
Paul. University of Illinois, Urbana, Illinois. 

Willing's Scale for Measuring Written G>mpo8ition. This scale consists of eight 

compositions arranged in order of both "form" and "story value." AU of the 

compositions were written by school children under controlled conditions. 

This scale may be used in grades iv to xn inclusive. 

Publisher: Bureau of Educational Research, University of Illinois, Urbana, 

Illinois. 

V Reference: Willing, M. H. "Measurement of written composition in grades iv 

to vm," English Journal, 7:193-202, March, 1918. 

Considers the derivation of the test, also its giving and scoring. Although this scale was 
designed for use in the upper grades of the elementary school, it can be used profitably in the high- 
school. 

B. Copying 

Boston Test in Accurate G>|i3ring. Test was prepared by the conmiittee on standards 

in English. It was given to first-year pupils. 

Reference: English: determoning a standard in accurate copying. (Bulletin No. 6 of 

the Department of Educational Investigation and Measurement, Boston 

PubUc Schools, 1916). 

This buUetin consists of a report on the Test in Accurate Copying given to 4,494 first-year high 
school pupils in November, 1914. Test is r^roduced. 

Kansas City, Missouri, public schools, buUetin no. 1 of the Bureau of Research 

and Efficiency, February, 1916, p. 55. 

Analysis of errors made in Kansas Qty, Missouri, by ages and grades. The test also with 
directions for giving and scoring are given. 
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f// liM; v«:ry dlfikuli. There are two scales for the high school, L and M. 
I'MUh^r: Bureau of Publications, Teachers Cc^kge, Columbia Univeisityy 
New Voric City. Also obtainable frmn Bureau of Educational Reseaidb, 
University of lUinoii, Urbana, Illinois. 
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References: Trabue, M. R. ComfkUon-test language scales. (Teachers' College, 

Gilumbia University Contributions to Education, No. 77) New York: 

Teachers College, Columbia University, 1916. 

The author states: ''This monograph is the report of an attempt to derive one or more scales 
for the measurement of ability along certain lines closely related to language.*' 

Account of its use in the high school may be foimd in: — 

Report of a survey of public education in Nassau County, New York, Albany, 

New York: University of the State of New York, 1918, p. 177 ff. 
Report of a survey of the school system of St. Paul, Minnesota, 1917, p. 433 ff ., table 

inserted before p. 453, 460, 487. 

E. Spelling 

Ayres' SpeOing Scale. A thousand words constituting a fundamental English vocabu- 
lary have been grouped in this scale according to their spelling difficulty as indi- 
cated by the percent of correct spellings. The words were selected from four 
important reports on the frequency with which words are used in letters, news- 
paper articles, the English Bible, and various authors. The approximate percent 
of correct spellings to be expected in each grade is shown for each word. Although 
not intended for use in the high school this scale has been used by some above the 
eighth grade. 
Publisher: Division of Education, Russell Sage Foundation, New York City. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urbana, Illinois. 
References: Ayres, L. P. A measuring scale for ability in spelling. New York: 

Division of Education, Russell Sage Foundation, 1915. 
Courtis, S. A. The Gary public schools: measurement of classroom products. New 

York: General Education Board, 1919. 
Scofield, F. A. ^'Difficulty of A3n-es* spelling scale as shown by the spelling of 

560 high school students," School and Society, 4^339-40, August 26, 1916. 

Account of its use in the junior high school and senior high school, Eugene, Oregon. 
Scofield, F. A. ''An experiment in spelling in the Eugene high school," Schod 

and Society, 5:299-300, March 10, 1917. 

Buckingham's Extension of the Ayres' Spelling Scale. This extension adds 509 words 
to the original Ayres' Spelling Scale making a scale of 1,509 words. The additions 
are mainly at the more difficult end of the scale and will thus add to its value 
especially for grammar grades and the high school. Scale is for use in grades 
n to DC 

Publisher: Bureau of Educational Research, University of Illinois, Urbana, 
Illinois. 

Buckingham's Spelling Scale. This was the first published spelling scale. It consisted 
of fifty words very carefully evaluated together with about one hundred and 
twenty-five supplementary words. The scale as such has not been published 
separately. Some of the words now appear in the Buckingham's Extension of the 
Ayres' Spelling Scale mentioned above. 
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PMisker: Not obtainable. 

Reference: Buckingham, B. R. Spelling ability: its measurement and distribution. 

(Teachers' College, Columbia University Contributions to Education, No. 

59). New York: Teachers College, Columbia University, 1913. 

Considers tbe derivatioo of scale. Scale is reixodticed. 

An educational survey of Janesville, Wisconsin, Madison, Wisconsin: State 
Department of Public Instruction, 1918, p. 272. 

Account of the Buckingham sizty^ve word list in the high scho(4. 



' Dictation Spelling Tests. There are four tests in this series, each of which 
contains twenty test words embedded in sentences. 
^ Publisher: S. A. Courtis, 82 Eliot Street, Detroit, Michigan. 
Reference: Courtis, S. A. The Gary public schools: measurement of classroom 
products. New York: General Education Board, 1919, pp. 87-92. 

lone's One Hundred Spelling Demons. This is a list of the one himdred words most 
frequently misspelled by children in the elementary school. 
Address: W. F. Jones, University of South Dakota, Vermillion, South Dakota. 
Reference: Jones, W. F. Concrete investigation of the material of English spelling. 

Vermillion, South Dakota: University of South Dakota, 1914. 

This is an account of the investigation in which list was secured. 

Monroe, Walter S., De Voss, J. C, and Kelly, F. J. Educational tests and measure" 
ments. Boston: Houghton Mifflin Company, 1917, p. 133. 
The One Hundred Spelling Demons are reproduced. 

Account of the use of the '^Demons" in high school may be found in the 
following: 

Annual report of the Des Moines public schools, 1915, part 2, p. 10 ff. 
Annual report of the public schools of Johnstown, Pennylvania, 1918, p. 111-113. 
Courtis, S. A. The Gary public schools: measurement of classroom products. New 

York: General Education Board, 1919, p. 92 ff., 414 ff. 

Jones' Spelling Demons used in analyzing misspelled words in the composition of eighth-grade 
children. 

School report of the town of Southington, Connecticut, 1919, p. 21. 
Annual report of the school department of the city of Pittsfield, Massachusetts, 1916, 
p. 23-24. 

Monroe's Timed Sentence SpeOing Teat This is a series of three tests each of which 
consists of fifty words taken from suitable columns of the Ayres' Spelling Scale 
and embedded in sentences. The sentences are then so arranged that they may be 
dictated at approximately the normal rate of writing in each of the grades. Test 
III is used in grades vn and vin and in the high school. 
Publishers: Bureau of Educational Research, University of Illinois, Urbana, 

Illinois. 
Monroe, Walter S., De Voss, J. C, and Kelly, F. J. Educational tests and measure- 
ments. Boston: Houghton Mifflin Co., 1917, p. 119. 
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V. Foreign Languages 

Handschin's Foreign Language Tests. Series of four short tests for the purpose of 
discovering types of learners in language study. 
Address: Charles H. Handschin, Oxford, Ohio. 
Reference: Handschin C. H. "A test for discovering types of learners in language 

study," Modem Language Journal, 3:1-4, October, 1918. 

Tests reproduced and directions given. 

A. French 

Henmon's French Tests. A series of tests in French similar to the author's Latin tests. 
Publisher: V. A. C. Henmon, University of Wisconsin, Madison, Wisconsin. 
Reference, Henmon, V. A. C. "The measurement of ability in French," Journal 
of Educational Research, (To appear in the first volume.) 

Starch's French Reading Test This test is composed of a series of thirty sentences 
arranged roughly in the order of increasing difficulty. The sentences were from 
the readings usually covered in the first year of the high school. 

^ Starch's French Vocabolary Test The test is composed of two numbered lists of 
one hundred French words each and corresponding lists of their English equiva- 
lents. The pupil is asked to write after each French word a number of its English 
equivalens. 
' Publisher: University Cooperative Company, Madison, Wisconsin. 
Reference: Starch, Daniel. Educational measurements. New York: Macmillan, 
1916. 

In Chapter Xm "The Measurement of Ability in French" the French vocabulary and sentence 
tests are reproduced. Derivation is described. 

Wilkins' Predetermination Test in French. After anal3rzing language ability Mr. 
Wilkins derives a test for French which consists of five parts: 

(1) seeing and writing 

(2) hearing and writing 

(3) seeing and speaking 

(4) hearing and speaking 

(5) grammatical concepts. 

Reference; Wilkins, L. A. 'Testing for ability to learn a foreign language, "B«/- 

iHin of High Points in the Work of the High Schools of New York City, v. 1, 

no. 2, p. 5, February, 1919; no. 8, p. 26, October, 1919. 

A discussion of the test and scoring is followed by the reproduction of the test. Result are 
given in the October Number. 

6. German 

Starch's German Reading Test. This test, like the one for French, is composed of a 
series of sentences arranged roughly in the order of increasing difficulty. The 
sentences were selected from first-year texts and from the authors usually covered 
in four years of German. 
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(1) Tests I and n are of equal difficulty and each consists of ten sen- 
tences arranged in order of increasing difficulty. 

(2) Test m is a selection of ten sentences of approximately the same 
difficulty. 

Publisher: V. A. C. Henmon, University of lA^sconsin, Madison, Wisconsin. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urbana, Illinois. 
Reference: Henmon, V. A. C. "Measurement of abDity in Latin," Journal of 

of Educational Psychology, 8:515-38, 589-99, November-December, 1917. 

This article gives the derivation of the tests. 



Lohr's Latin Test. This is a "form test" to be given at the end of the first year. Pupils 

are asked to identify the forms of certain nouns, pronouns, and verbs. 

, Address: School of Education, University of North Carolina, Chapel Hill, North 

Carolina. 

Reference: Lohr, L. L. "A Latin form test for use in high school classes," High 

School J oumai, 1:7-9, 14-17, November-December, 1918. 

Gives critical account of the ^)i»opriatenesB of Starch's Latin tests and the derivation of a 
form test. 



Starch's Latin Vocabnlary Tests. 
Starch's Latin Reading Test 

See Starch's French Tests for a description of these two tests. 

Publisher: These scales have been withdrawn from distribution. 

Reference: Starch, DanieL Educational measurements. New York: Macmillan, 

1916. 

See Chapter XI: "Measurement of ability in Latin/' for reproduction of tests, and their deriva- 
tion. 



Starch-Watters' Latin Tests. This is a second series of Latin tests prepared by Pro- 
fessor Starch, in collaboration with Mr. Watters. It consists of (1) Latin vocabu- 
lary test based on Lodge's Vocabulary of High School Latin; (2) translation tests 
for each of the four years of the high school course. 
Address: University Cooperative Co., Madison, Wisconsin. 

Wentworth Latin Tests. Test 1 consists of one hundred English words, some of which 
come from the Latin. The pupil is to mark each word showing whether it comes 
from the Latin or not. Test 2 consists of one htmdred English words which are 
derived from the Latin. The pupil is to give the Latin root. 
Address: Mary M. Wentworth, Hollywood High School, Los Angeles, California. 
Reference: Wentworth, M. M. "An experiment with two Latin tests," School 
Document No, 26, Los Angldes City School District y Division of Educational 
Research, October, 1919. 

D. Spanish 

Wilkins' Predetermination Test in Spanish. Mr. Wilkins states that language ability 
is predicted largely upon (1) susceptibility to impression; (2) readiness and 
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iccmacy of expreasaoD; (3) cnsps oi orcfiminr pazzmnticmi co D c ep ts . Tbere are 
four vays ior tesdz^g cspresaoo and expressaoa: 

1. VisQaJ — niotor (seexnz and writing* 

2. Aczal — motor (hraring and writing) 

3. \lsaal — oral (seeing and speaking) 

4. Aoral — oral (hearing and speaking^^ 
Tlien there is a test of gramniatical coocepts^ 

Reference'. \ITIkins, L. A. ^Testing for abOit>' to leam a foreign language." 
BtdUHn of High Paints in tie Work of the High StJ^mTi of Xex York City, 

V. 1, no. 2, p. 5, Fd>n]ar>', 1919; October, 1919, no. 8, p. 26. 
A i 8i i ■ ■ Mm of the tat and ■corit a iaUkmcd by the i rpn wUrrinw of tht tct. Reanlts are 
in theGctobcr 



\7. Handwriting 

Ayrcs* Scale ior Mcasni^ Ike QuGty el Hjndwfkiiig el AJidta. This scale is similar 
to the well-known A>Tes' Scale, "three slant edition'* except samples of the 
handwriting of adults were used in its construction. 

Publisher: Russdl Sage Foundation, Division of Education. New York City. 
References: .\>Tes, L. P. A scale for measuring the quality of kandurriting of adults. 

(Division of Education, Russell Sage Foundation, Bulletin E 138.) 
Penmanship: determining the achievement of elementary school graduates in hand" 

writing (Bulletin No. DC of the Department of Educational Investigation and 

^leasurement, Boston Public Schools, 1916.) 

"Od Norember 23, 1914, a test in accurate oopjmc was shren to 4,494 poptls in the fixat-ycar 
daaacs of fourteen high scboob in Boston. In the test nothinc was said to the popiii aboot tkcir 
penmanship, faeoce they <iid not know that the qoalxtj ol their handwriting was to be oooskkred." 
The Ayres* Scak for Measuring Handwriting of Adults was nsed m rating these wnpirt Resohs 
are given. 

Johnston, J. H. ''A comparison of the A>Tes and Thomdike handwriting scales 
(containing a table of equivalent >'alues in the two scales)," North Carolina 
High School Bulletin, 7 :170.73, October, 1916. 

Ayres' Handwriting Scale, "Gettysburg Editmi.'* This b the latest edition of Ayres' 
handwriting scales. Numerous changes have been introduced which make it a 
noore accurate instrument than the "three slant edition." It uses the first three 
sentences of the "Gettysburg Oration" as copy material 
Publisher: Russell Sage Foundation, Division of Education, New York City. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urfoana, Illinois. 
References: Breed, F. S. "The comparative accuracy of the Ayres Handwriting 

Scale, (Gettysburg Edition," Elementary School Journal, 18:459-63, February, 

1918. 

The "Gettysburg Edition" is shown to yield more accorate measures than the "three slant 
edition." 

Lewis, E. E. 'The present standard of handwriting in Iowa Normal Training 
High Schools," Educational Administration and Supendsion, 1 :663-71, Decem- 
ber, 1915. 

"This report describes an investigation of the quality and speed of the handwriting of 1,760 
third and fborth^ear students in 166 Iowa Normal Training High Schools." 
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Ayres' Measuring Scale for Handwriting, 'Three Slant Edition." This is the first of 
the handwriting scales devised by L. P. Ayres. 

Publisher: Russell Sage Foundation, Division of Education, New York City. 
References: Ajn-es, L. P. A scale for measuring the qu/Uily of the handwriting of 
school children, (Division of Education, Russell Sage Foundation, Bulletin 

No. 113). 

This is an account of the derivation of the scale. 
G)urtis, S. A. The Gary public schools: measurement of classroom products. New 
York: General Education Board, 1919, p. 68. 

Qeveland Free Qioice Test. This refers only to the method of securing samples of the 
handwriting of pupils. 

Reference: Courtis, S. A. The Gary public schools: measurement of classroom 
products. New York: General Education Board, 1919, p. 49. 

Vn. History 
A. General 

Rugg's Tests for Historical Judgment. 

Address: E. U. Rugg, Oak Park High School, Oak Park, Illinois. 

Reference: Rugg, E. U. "Character and value of standardized tests in history," 

School Review, 27: 757-71, December, 1919. 

The author discusses the existing tests in the field, general features and general criticisms of 
existing tests, value of the testing movement in history. He inserts a table which gives the following 
information: name and title, where reported, type, kind of questions and general comment. 

B. Ancient History 

Barnard's Test in Roman History. A test covering one period of ancient history. 
Address: A. F. Barnard, University High School, University of Chicago, Chicago, 
Illinois. 

Sackett's Scale in Ancient History. This scale is composed of six tests based on care- 
fully selected information in ancient history. 

Publisher: L. W. Sackett, University of Texas, Austin, Texas. Also obtainable 
from Bureau of Educational Research, University of Illinois, Urbana, Illi- 
nois. 
Reference: Sackett, L. W. '^A scale in ancient history," Journal of Educational 

Psychology, 8:284-93, May, 1917. 
This article gives the derivation of the scale. 

C. United States History 

Barr's Diagnostic Tests in United States History. A test to diagnose historical abili- 
ties. 
Address: A. S. Barr, 19 S. La Salle Street, Chicago, Illinois. 

Harlan's Test of Information in American History. This is an information test in 
American history. It consists of ten exercises based on an analytical study of 
textbooks in American history. This test gives the teacher a measure of the 
efficiency with which the information side of American history has been taught. 
It may be used in first year of high school. 
Publsher: Bureau of Educational Research, University of Illinois, Urbana, Illinois. 
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An educational survey of JanesviUe, Wisconsin, Madison, Wisconsin: State De- 
partment of Public Instruction, 1918, p. 287. 

Gunther, Charles. ''My experience with the Hillegas scale,'' English Joumaly 

2:535-42, November 1919. 

Describes a series of experiments carried on by four teachers in the use of the Hillegas scale. 
Mr. Gunther in his conclusion deSnitely states that through the Hillegas or some similar scale greater 
unifonnity is gained than through a percent scale. 

]ffillegas, Milo 6. "Hillegas scale for measurement of English composition," 

Teachers CoUege Record, 13:331-84, September, 1912.. 
Johnson, F. W. "The Hillegas-Thomdike scale for measuring the quality in 

English composition by young people'' School Review f 21 :39-49, January, 1913. 
Kayetz, Isidor. "A critical study of the Hillegas composition scale," Pedagogical 

Seminary, 21:559-77, December, 1914. 

The first part of the article is concerned with the scale itself; the second part devoted to a 
criticism by the author and others. References relative to the scale follow. 

Parker, F. E. "Value of measurements," English Journal, 8:203-17, April, 1919. 

A criticism on the use of the Hillegas scale by a subcommittee of the Detroit English Qub. 
S. A Courtis discusses the "Use of the Hillegas Scale" in the second part of this article. 

School report of the town of Southington, Connecticut, 1917, p. 12. 

Stoddard, W. E. "Comparison of the Hillegas and Harvard Newton scales in 
English composition," Pedagogical Seminary 23:498-501, December, 1916. 
Moat valuable for its criticism of the Hillegaa scale. 

Thomdike, E. L. "Notes on the significance and use of the Hillegas Scale for 
measuring the quality of English composition," English Journal^ 2:551-561, 
November, 1913. 

Minnesota English G>mpo8ition Scale. 

Reference: Van Wagenen, M. J. "The Minnesota English composition scale, its 
derivation and validity." To be published in the first volume of the Journal 
of Educational Researhc. 

Nassau G>nnty Supplement to the Hillegas Scale. This scale is a simplification and 
improvement of the original Hillegas Composition Scale. It consists of a series of 
compositions written under controlled conditions and arranged in order of general 
merit. 

Publishef: Bureau of Publications, Teachers College, Columbia University, New 
York City. Also obtainable from Bureau of Educational Research, Univer- 
sity of Illinois, Urbana, Illinois. 
References: Theisen, W. W. "Improving teachers' estimates of composition 
specimens with the aid of the Trabue Nassau County scale," School and 
Society, 7:143-150, February 2, 1918. 

Discusses the outcomes of an experiment prompted by the question: "Can teachers improve 
their Judgment of the merit of compositions through use of the scak?" 
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Trabue, M/R. ''Supplementing the Hillegas composition scale," Teachers College 

Record, 18:51-84, January, 1917. 

Reasons for constructing the Nassau Gninty supplement, its advantages over the Hillegas 
scale. Table V lists the "estimates of quality to be expected from high school seniors and sophomores'* 
in the use of the Hillegas scale. 

An account of the use of scale in the high school may be found in the following: 
Report of a Survey of Public Education in Nassau County, New York. Albany, 

New York: University of the State of New York, 1918, p. 149 ff. 
Report of a survey of the school system of St. Paul, Minnesota, 1917, p. 456. 

Scores are given for St. Paul, Minnesota; Mobile and Mobile County, Alabama; Nassau 
County, and South River, New York; Lead, South Dakota, 

Topeka Scale for Jud^g G>mpo8ition8. This scale was devised by the English 

department of the high school in Topeka, Kansas. 

Address: Carmie S. Wolfe, High School, Topeka, Kansas. 

Reference: "The Topeka scale for judging compositions,'* Bulletin of the Illinois 

Association of Teachers of English, v. 9 no. 6. March, 1, 1917. 

' Scale reproduced and derivation described. For a copy of the bulletin address Professor H. G. 
Paul. University of Illinois, Urbana, Illinois. 

Willing's Scale for Measuring Written G>mpo8ition. This scale consists of eight 

compositions arranged in order of both "form" and "story value." AU of the 

compositions were written by school children tmder controlled conditions. 

This scale may be used in grades iv to xn inclusive. 

Publisher: Bureau of Educational Research, University of Illinois, Urbana, 

Illinois. 

V Reference: Willing, M. H. "Measurement of written composition in grades iv 

to vm," English Journal, 7:193-202, March, 1918. 

Considers the derivation of the test, also its giving and scoring. Although this scale was 
designed for use in the upper grades of the elementary school, it can be used profitably in the high- 
school. 

B. Copying 

Boston Test in Accurate G>|i3ring. Test was prepared by the committee on standards 

in English. It was given to first-year pupils. 

Reference: English: determoning a standard in accurate copying. (Bulletin No. 6 of 

the Department of Educational Investigation and Measurement, Boston 

Public Schools, 1916). 

This bulletin consists of a report on the Test in Accurate Copying given to 4,494 first-year high 
school pupils in November, 1914. Test is r^roduced. 

Kansas City, Missouri, public schools, bulletin no. 1 of the Bureau of Research 

and Efficiency, February, 1916, p. 55. 

Analysis of errocs made in Kansas Gty, Missouri, by ages and grades. The test also with 
directions for giving and scoring are given. 
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C. Grammar and Punctuation 

Qemens* Grammar Test A test consisting of thirteen sentences in which the pupil is 

asked to make a choice between the correct and incorrect words. This test is 

based on E. C. WooUe/s Handbook of Composition. 

^ Address: A. H. Clemens, Principal of High School, Rochester, Minnesota. 

Reference: Report of the board of education of Rochester f Minnesota, 1912-1918, p. 40. 

The test is reproduced, with a key to the sections ia WooUey's Handbook. Tentative standard 
scores are also given. 

Starch's Grammatical Scales. Starch has devised three scales (A, B, and C) to measure 
a pupil's ability to use correctly certain language forms. 

Starch's Tests for Measuring Grammatical Knowledge. The three tests in this series 
consist of selections in which the pupil is asked to indicate certain parts of speech 
or certain inflected forms. 

Publisher: University Cooperative Company, Madison, Wisconsin. 
References: Starch, D. Educational measurements, New York: Macmillan, 1916. 

See Chapter VII entitled "The measurement of ability in English grammar," ifor a reproduction 
of the tests and standards. 

Starch, Daniel. "The measurement of achievement in English grammar," 
Journal of Educational Psychology, 6:615-26, December, 1915. 

Qemens' Ponctnation Test. A list of twenty-eight sentences which are to be punc- 
tuated. Based on £. C. Woolle/s Handbook of Composition. 
Address: A. H. Clemens, Principal of High School, Rochester, Minnesota. 
Reference: Report of the board of education of Rochester, Minnesota, 1912-1918, 

p. 42. 

The test with a key to the sections in the Handbook is reproduced. 

Starch's Ponctnation Scale. This scale consists of a series of groups of sentences which 

are to be punctuated. The groups are arranged in order of difficulty. It will be 

useful in the high schooL 

Publisher: University Cooperative Company, Madisdn, Wisconsin. Also obtain- 
able from the Bureau of Educational Research, University of Illinois, Urbana, 
Illinois. 

References: Starch, Daniel. Educational measurements. New York: Macmillan 

Company, 1916. 

See Chapter vii entitled "The measurement of ability in English grammar/' for a reproductioD 
of test, and standards. 

Starch, Daniel. "The measurement of achievement in English grammar," 
Journal of Educational Psychology, 6:615-26, December, 1915. 

D. Language 
Trabue's Completion-Test Langmige Scales. These scales are composed of "com- 
pletion sentences" which are arranged in order of difficulty from the very simple 
to the very difficult There are two scales for the high school, L and M. 
Publisher: Bureau of Publications, Teachers College, Columbia University, 
New York City. Also obtainable from Bureau of Educational Research, 
University of Illinois, Urbana, Illinois. 
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References: Trabue, M. R. Compietum4est language scales. (Teachers' G)llege, 

Columbia University Contributions to Education, No. 77) New York: 

Teachers College, Columbia University, 1916. 

The author states: "This monograph is the report of an attempt to derive one or more scales 
for the measurement of ability along certain lines closely related to language." 

Accotmt of its use in the high school may be fotmd in: — 

Report of a survey of public education in Nassau County, New York. Albany, 

New York: University of the State of New York, 1918, p. 177 ff. 
Report of a survey of the school system of St. Paul, Minnesota, 1917, p. 433 ff., table 

inserted before p. 453, 460, 487. 

E. Sfeluno 

Ayres' Spelling Scale. A thousand words constituting a fundamental English vocabu- 
lary have been grouped in this scale according to their spelling difficulty as indi- 
cated by the percent of correct spellings. The words were selected from four 
important reports on the frequency with which words are used in letters, news- 
paper articles, the English Bible, and various authors. The approximate percent 
of correct spellings to be expected in each grade is shown for each word. Although 
not intended for use in the high school this scale has been used by some above the 
eighth grade. 
Publisher: Division of Education, Russell Sage Foundation, New York City. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urbana, Illinois. 
References: Ayres, L. P. A measuring scale for ability in spelling. New York: 

Division of Education, Russell Sage Foundation, 1915. 
Courtis, S. A. The Gary public schools: measurement of classroom products. New 

York: General Education Board, 1919. 
Scofidd, F. A. "Difficulty of Ayres* spelling scale as shown by the spelling of 

560 high school students," School and Society, 4:339-40, August 26, 1916. 

Account of its use in the junior high school and senior high school, Eugene, Oregon. 
Scofield, F. A. "An experiment in spelling in the Eugene high school," School 

and Society, 5:299-300, March 10, 1917. 

Buckingham's Extension of the Ayres' Spelling Scale. This extension adds 509 words 
to the original Ayres' Spelling Scale making a scale of 1,509 words. The additions 
are mainly at the more difficult end of the scale and will thus add to its value 
especially for grammar grades and the high school. Scale is for use in grades 
n to IX. 

Publisher: Bureau of Educational Research, University of Illinois, Urbana, 
Illinois. 

Buckingham's Spelling Scale. This was the first published spelling scale. It consisted 
of fifty words very carefully evaluated together with about one hundred and 
twenty-five supplementary words. The scale as such has not been published 
separately. Some of the words now appear in the Buckingham's Extension of the 
Ayres' Spelling Scale mentioned above. 
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Publisher: Not obtainable. 

Reference: Buckingham, B. R. Spelling ability: its measurement and distribution. 

(Teachers* College, Columbia University Contributions to Education, No. 

59). New York: Teachers College, Columbia University, 1913. 

G>nsiders the derivation of scale. Scale is reproduced. 

An educational survey of JanesvUle, Wisconsin, Madison, Wisconsin: State 
Department of Public Listruction, 1918, p. 272. 
Account of the Buckingham sixty-five word list in the high schooL 

Giiutis' Dictation Spelling Tests. There are four tests in this series, each of which 
contains twenty test words embedded in sentences. 
* Publisher: S. A. Courtis, 82 Eliot Street, Detroit, Michigan. 
Reference: Courtis, S. A. The Gary public schools: measurement of classroom 
products. New York: General Education Board, 1919, pp. 87-92. 

lone's One Hundred Spelling Demons. This is a list of the one hundred words most 
frequently misspelled by children in the elementary school. 
Address: W. F. Jones, University of South Dakota, Vermillion, South Dakota. 
Reference: Jones, W. F. Concrete investigation of the material of English spelling, 

Vermillion, South Dakota: University of South Dakota, 1914. 

This is an account of the investigation in which list was secured. 

Monroe, Walter S., De Voss, J. C, and Kelly, F. J. Educational tests and measure- 
ments. Boston: Houghton Mifflin Company, 1917, p. 133. 
The One Hundred Spelling Demons are reproduced. 

Account of the use of the "Demons'' in high school may be found in the 
following: 

Annual report of the Des Moines public schools, 1915, part 2, p. 10 ff. 
Annual report of the public schools of Johnstown, Pennylvania, 1918, p. 111-113. 
Courtis, S. A. The Gary public schools: measurement of classroom products. New 

York: General Education Board, 1919, p. 92 ff., 414 ff. 

Jones' Spelling Demons used in analysing misspelled words in the composition of eighth-grade 
children. 

School report of the town of Southing^, Connecticut, 1919, p. 2 1 . 
Annual report of the school department of the city of Pittsfield, Massachusetts, 1916, 
p. 23-24. 

Monroe's Timed Sentence Spelling Test This is a series of three tests each of which 
consists of fifty words taken from suitable columns of the Ayres' Spelling Scale 
and embedded in sentences. The sentences are then so arranged that they may be 
dictated at approximately the normal rate of writing in each of the grades. Test 
III is used in grades vn and vm and in the high school. 
Publishers: Bureau of Educational Research, University of Illinois, Urbana, 

Illinois. 
Monroe, Walter S., De Voss, J. C, and Kelly, F. J. EducaHonal tests and measure- 
ments, Boston: Houghton Mifflin Co., 1917, p. 119. 
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V. Foreign Languages 

Handschiii's Foreign Langaage Tests. Series of four short tests for the purpose of 
discovering types of learners in language study. 
Address: Charles H. Handschin, Oxford, Ohio. 
Reference: Handschin C. H. "A test for discovering types of learners in language 

study," Modem Language Journal, 3:1-4, October, 1918. 

Tests reproduced and directions given. 

A. French 

Henmon's French Tests. A series of tests in French similar to the author's Latin tests. 
Publisher: V. A. C. Henmon, University of Wisconsin, Madison, Wisconsin. 
Reference, Henmon, V. A. C. "The measurement of ability in French," Journal 
of Educational Research. (To appear in the first volume.) 

Starch's French Reading Test This test is composed of a series of thirty sentences 
arranged roughly in the order of increasing difficulty. The sentences were from 
the readings usually covered in the first year of the high school. 

^ Starch's French Vocabulary Test. The test is composed of two numbered lists of 
one hundred French words each and corresponding lists of their English equiva- 
lents. The pupil is asked to write after each French word a number of its English 
equivalens. 
• Publisher: University Cooperative Company, Madison, Wisconsin. 
Refererice: Starch, Daniel. Educational measurements. New York: Macmillan, 
1916. 

In Chapter xm "The Measurement of Ability in French" the French vocabulary and sentence 
tests are reproduced. Derivation is described. 

Willdns' Predetermination Test in French. After analyzing language ability Mr. 
Wilkins derives a test for French which consists of five parts: 

(1) seeing and writing 

(2) hearing and writing 

(3) seeing and speaking 

(4) hearing and speaking 

(5) grammatical concepts. 

Reference: Wilkins, L. A. "Testing for ability to learn a foreign language, **Bul- 

letin of High Points in the Work of the High Schools of New York City, v. 1, 

no. 2, p. 5, February, 1919; no. 8, p. 26, October, 1919. 

A discussion of the test and scoring is followed by the rq>roduction of the test. Result are 
given in the October Number. 

B. German 

Starch's German Reading Test. This test, like the one for French, is composed of a 
series of sentences arranged roughly in the order of increasing difficulty. The 
sentences were selected from first-year texts and from the authors usually covered 
in four years of German. 
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Staiccii's Gcnntn Vocalnilary Tests. Professor Starch states: ''The test is composed of 
two sets of 100 words each. These words are selected by taking the first word on 
every 23rd page of the large Muret-Sanders German-English Dictionary." 
PMisker: University Cooperative Co., Madison, Wisconsin. 
Reference: Starch, Daniel. Educational measurements. New York: Macmillan, 
1916. 
In Chapter Xn: "The measurement of ability in G«nnan" tests are r^voduced. 

C. Latin 
Brown's Latin Tests; 

1. Connected Latin Test. This test consists of a connected passage of Latin. The 

pupils are given a specified amount of time in which to interpret and write in 
English as much of the passage as possible. 

2. Latin Sentence Test. This consists of a series of Latin sentences ranging from 

very easy to very difficult 

3. Formal Latin Vocabulary Test. A list of words occurring in the Latin Sentence 

Test 

4. Formal Latin Grammar Test. This test is made up of twenty constructions in 

Latin sentences. The constructions are in italics and the pupils are required 
to name and describe them but not to translate the sentences. 

5. Functional Latin Grammar Test. A series of Latin constructions chosen from 

the Latin Sentence Test. The pupils are graded on their ability to read 

correctiy these constructions in their normal settings. 
Publisker: Parker Educational Company, Madison, Wisconsin. 
Reference: Brown, H. A. il study of ability in Latin. Oshkosh, Wisconsin: 

H. A. Brown, 1920. 

Hanos* Latin Tests. These consist of four tests for vocabulary, a translation test and a 

grammar test All of these tests are based on Caesar and Cicero. No words 

appear in the vocabulary tests ' Vhich occur less than one hundred times in Caesar 

and Cicero." The translation test ''contains only constructions which are fotmd 

at least 500 times in Caesar and Cicero." 

Address: Paul Hanus, Harvard University, Cambridge, Massachusetts. 

Reference: Hanus, P. H. ''Measuring progress in learning Latin," School Review, 

24:342-345, May, 1916. 

Four Latin vocabulary tests are reproduced with suggested credit, directions for grading and 
making oorrdations. 

Henmon's Latin Tests. 

1. Latin Vocabulary Tests selected from 239 words common to thirteen beginners' 

books and to Caesar and VergiL 

(1) Texts A, B, C, and D are of equal difficulty and each consists of 
fifty words arranged in order of increasing difficulty. 

(2) Text X is a selection of 25 words having approximately the same 
scale values, which may, therefore, be disregarded in scoring and each word 
given the same weight 

2. Latin Sentence Tests, Graded sentences containing no word not included in 
the 239 standard words. 
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(1) Tests I and n are of equal diflkulty and each consists of ten sen- 
tences arranged in order of increasing difi&culty. 

(2) Test m is a selection of ten sentences of approximately the same 
difficulty. 

Publisher: V. A. C. Henmon, University of Wisconsin, Madison, Wisconsin. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urbana, Illinois. 
Reference: Henmon, V. A. C. ''Measurement ol ability in Latin," Journal of 

of Educational Psychology, 8:51S38, 589-99, November-December, 1917. 

This article gives the denvat&m ol the tests. 

Loin's Latiii Test. This is a "form test" to be given at the end of the first year. Pupils 
are asked to identify the forms of certain nouns, pronouns, and verbs. 
» Address: School of Education, University of North Carolina, Chapel Hill, North 
Carolina. 
Reference: Lohr, L. L. ''A Latin form test for use in high school classes," High 
School Journal, 1 :7-9, 14-17, November-December, 1918. 

Gives critical account of the appropriateness ol Starch's Latin tests and the derivaticm of a 
form test. 

Starch's Latiii Vocalnilary Tests. 
Starch's Latiii Reading Test. 

See Starch's French Tests for a description of these two tests. 
Publisher: These scales have been withdrawn from distribution. 
Reference: Starch, Daniel. Educational measurements. New York: Macmillan, 
1916. 

See Chapter XI: "Measurement of ability id Latin," for reproduction of tests, and their deriva- 
tion. 

Starch- Watters' Latin Tests. This is a second series of Latin tests prepared by Pro- 
fessor Starch, in collaboration with Mr. Watters. It consists of (1) Latin vocabu- 
lary test based on Lodge's Vocabulary of ICgh School Latin; (2) translation tests 
for each of the four years of the high school course. 
Address: University Cooperative Co., Madison, Wisconsin. 

Wentworth Latin Tests. Test 1 consists of one hundred English words, some of which 
come from the Latin. The pupil is to mark each word showing whether it comes 
from the Latin or not. Test 2 consists of one hundred English words which are 
derived from the Latin. The pupil is to give the Latin root. 
Address: Mary M. Wentworth, Hollywood High School, Los Angeles, California. 
Reference: Wentworth, M. M. "An experiment with two Latin tests," School 

Document No, 26, Los Angleles City School District, Division of Educational 

Research, October, 1919. 

D. Spanish 

Wittdns' Predetermination Test in Spanish. Mr. Wilkins states that language ability 
is predicted largely upon (1) susceptibility to impression; (2) readiness and 
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accuracy of expression; (3) grasps of ordinary grammatical concepts. There are 
four ways for testing impression and expression: 

1. Visual — ^motor (seeing and writing) 

2. Aural — ^motor (hearing and writing) 

3. Visual — oral (seeing and speaking) 

4. Aural — oral (hearing and speaking) 
Then there is a test of grammatical concepts. 

Reference: Wilkins, L. A. "Testing for ability to learn a foreign language/' 

Bulletin of High Paints in the Work of the High Schools of New York City, 

V. 1, no. 2, p. 5, February, 1919; October, 1919, no. 8, p. 26. 
A discussion of the test and scoring is followed by the reproduction of the test. Results are 
given in the October Number. 

VI. Handwriting 

Ayres' Scale for Measuring the Quality of Handwriting of Adults. This scale is similar 

to the well-known Ayres* Scale, "three slant edition" except samples of the 

handwriting of adults were used in its construction. 

Publisher: Russell Sage Foundation, Division of Education, New York City. 

References: Ayres, L. P. A scale for measuring the quality of handwriting of adults, 
(Division of Education, Russell Sage Foundation, Bulletin £ 138.) 

Penmanship: determining the achievement of elementary school graduates in hand- 
writing (Bulletin No. DC of the Department of Educational Investigation and 
Measurement, Boston Public Schools, 1916.) 

"On November 23, 1914, a test in accurate copying was given to 4,494 pupils in the first-year 
classes of fourteen high schools in Boston. In the test nothing was said to the pupils about their 
penmanship, hence they did not know that the quality of their handwriting was to be considered." 
The Ayres' Scale for Measuring Handwriting of Adults was used in rating these samples. Results 
are given. 

Johnston, J. H. "A comparison of the Ayres and Thomdike handwriting scales 
(containing a table of equivalent values in the two scales),'' North Cardifui 
High School BuUetin, 7 :170-73, October, 1916. 

Ayres' Handwriting Scale, "Gettysburg Edition." This is the latest edition of Ayres' 
handwriting scales. Numerous changes have been introduced which make it a 
more accurate instrument than the "three slant edition." It uses the first three 
sentences of the "Gettysburg Oration" as copy material. 
Publisher: Russell Sage Foundation, Division of Education, New York City. 

Also obtainable from the Bureau of Educational Research, University of 

Illinois, Urbana, Illinois. 
References: Breed, F. S. "The comparative accuracy of the Ayres Handwriting 

Scale, Gettysburg Edition," Elementary School Journal, 18:459-63, February, 

1918. 

The "Gettysburg Edition" is shown to yield more accurate measures than the "three slant 
edition." 

Lewis, £. E. "The present standard of handwriting in Iowa Normal Training 
High Schools," Educational Administration arul Supervision, 1 :663-71, Decem- 
ber, 1915. 

"This report describes an investigation of the quality and speed of the handwriting of t,760 
third and fourth-year students in 166 Iowa Normal Training High Schools." 
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kjTW^ Measuring Scale for Handwriting, '*Tliree Slant Edition." This is the first of 
the handwriting scales devised by L. P. Ayres. 

Publisker: Russell Sage Foundation, Division of Education, New York City. 
References: Ayres, L. P. A scale far measuring the quality of the handwriting of 
school children, (Division of Education, Russell Sage Foundation, Bulletin 

No. 113). 

This is an account of the derivation of the scale. 
G>urtis, S. A. The Gary public schools: measurement of classroom products. New 
York: General Education Board, 1919, p. 68. 

Qeveland Free Qioice Test. This refers only to the method of securing samples of the 
handwriting of pupils. 

Reference: Courtis, S. A. The Gary public schools: measurement of classroom 
products. New York: General Education Board, 1919, p. 49. 

Vn. History 
A. General 

Rugg's Tests for Historical Judgment. 

Address: E. U. Rugg, Oak Park High School, Oak Park, Illinois. 

Reference: Rugg, E. U. '* Character and value of standardized tests in history," 

School Review, 27: 757-71, December, 1919. 

The author discusses the existing tests in the field, general features and general criticisms of 
existing tests, value of the testing movement in history. He inserts a table which gives the following 
information: name and title, wl^re reported, type, kind of questions and general comment. 

B. Ancient History 

Barnard's Test in Roman History. A test covering one period of ancient history. 
Address: A. F. Barnard, University High School, University of Chicago, Chicago, 
Illinois. 

Sackett's Scale in Ancient History. This scale is composed of six tests based on care- 
fully selected information in ancient history. 

Publisher: L. W. Sackett, University of Texas, Austin, Texas. Also obtainable 
from Bureau of Educational Research, University of Illinois, Urbana, Illi- 
nois. 
Reference: Sackett, L. W. "A scale in ancient history," Journal of Educational 

Psychology y 8:284-93, May, 1917. 
This article gives the derivation of the scate. 

C. United States History 

Barr's Diagnostic Tests in United States History. A test to diagnose historical abili- 
ties. 
Address: A. S. Barr, 19 S. La Salle Street, Chicago, Hlinois. 

Harlan's Test of Information in American History. This is an information test in 
American history. It consists of ten exercises based on an analytical study of 
textbooks in American history. This test gives the teacher a measure of the 
efficiency with which the information side of American history has been taught. 
It may be used in first year of high school. 
Publsher: Bureau of Educational Research, University of Illinois, Urbana, Illinois. 
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SadKett's Scale in United States ffistory. This scale is composed of seven different 
tests based on carefully selected information in United States history. This scale 
can be used with pupils who have studied history above the sixth grade. It is 
difficult enough to test most high-school and college students. It is based upon the 
work of Bell and McCoUum. 
Publisher: L. W. Sackett, University of Texas, Austin, Texas. Also obtainable 

from Bureau of Educational Research, University of Illinois, Urbana, 

Illinois. 
Referefices: Bell, J. C. and McCollum, D. F. "A study of the attainments of 

pupils in United States history," Journal of Educational Psychology, 8:257- 

74, May, 1917. 

Sackett, L.W. "A scale in United States history," Journal of Educational 

Psychology, 10J45-49, September, 1919. 

Starch's American flSstory Test* Series A. This test consists of 69 mutilated sen- 
tences in which the pupil is asked to write the missing words or phrases. 
Publisher: University Cooperative Co., Madison, Wisconsin. 

Vm. Mathematics 

A. General 

Rogers' Mathematics Tests. These are a series of tests designed to measure several 
types of ability in the field of mathematics. The series include tests on arithmetic 
and algebra as well as geometry. 
Publisher: Bureau of Publications, Teachers College, Columbia University, 

New York City. 
Reference: Rogers, A. L. Experimental tests of mathematical ability and their 

prognostic value. (Teachers College Contributions to Education, No, 89.) 

New York: Teachers College, Columbia University, 1918. 
MiM Rogers dwnisscs in her thesis (1) summary of previous work; (2) general conditions of the 
present investigation, application of the tests and system of scoring; (3) analysis of mathematical 
ability; (4) prognosis of mathematical ability. 

B. Arithmetic 

Buckingham's Scale for Problems in Arithmetic This scale consists of three divisions 
called: Division 1, Division 2, and Division 3, which are designed for different 
grades. Each division consists of ten problems evaluated in terms of difficulty. 
Difficulty is understood to mean the difficulty of getting the correct answer. 
Problems in Division 3 are in most cases sufficiently difficult for use in the high 
school. 

Publisher: Bureau of ^Educational Research, University of Illinois, Urbana, 
Illinois. 

Cleveland Survey Arithmetic Tests. They were designed for use in the survey of the 
Cleveland public schools. The series consists of fifteen tests, including four in 
addition, two in subtraction, three in multiplication, four in division, and two in 
addition and subtraction of common fractions. 

Publisher: Bureau of Educational Research, University of Illinois, Urbana, 
Illinois. 
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Referettces: Counts, G. S. Arithmetic tests and studies in the psychology of arith- 
metic. (Supplementary Educational Monographs, v. 1, no. 4) Chicago: Uni- 
versity of Chicago Press, 1917. 

Courtis, S. A. The Gary public schools: measurement of classroom products. New 
York: General Education Board, 1919, p. 147. 

Conrtis Standard Research Tests, Series B. These are the well-known Courtis arith- 
metic tests. The series consists of four tests, one on each of the operations with 
integers. 

Publisher: S. A. Courtis, 82 Eliot St., Detroit, Michigan. Also obtainable from 
Bureau of Educational Research, University of Illinois, Urbana, Illinois. 

References: School report of the town of Southington, Connecticut ^ 1919, p. 24. 
An account of the use of the Gnirtis Arithmetic Tests, Series B, in first-year high-echool com- 
merdal classes. 

Courtis, S. A. The Gary public schools: measurement of classroom produces. New 

York: General Education Board, 1919, p. 147 ff. 

In addition to reporting on the use of these testa in the high school, the author gives an account 
of how his tests were constructed and a discussion of their validity and reliability. 

C. Algebra 

Coleman's Scale for Testing Ability in Algebra. This test consbts of a series of exer- 
cises arranged in order of difficulty. 
Publisher: W. H. Coleman, Bertrand, Nebraska. 

Hots's First- Year Algebra Scale. These scales consist of five lists of algebra exercises: 
(1) addition and subtraction; (2) multiplication and division; (3) equation and 
formula; (4) problems; and (5) graphs. In each list the exercises are arranged in 
order of difficulty. These scales are designed to determine the ability of pupils 
in terms of the exercises which just 50 percent of the class are able to solve cor- 
rectly. They are instruments for measuring the abilities of classes rather than of 
individuals. No measure of rate of work is secured. 

Publisher: Bureau of Publications, Teachers College, Columbia University, 
New York City. Also obtainable from Bureau of Educational Research, 
University of Illinois, Urbana, Illinois. 
References: Hotz, H. G. First-year algebra scales, (Teachers College Contribu- 
tions to Education, No. 90.) New York: Teachers College, Columbia 
University, 1918. 
Dr. Hotz in his thesis discusses the origin and use of the First- Year Algebra Scales. 

Cawl, F. R. "Practical uses of an algebra standard scale," School and Society^ 

10:88-90, July 19, 1919. 

An account of the ways in which the Hots First-year Algebra Scales are of value to the supcr> 
intendent and teacher. 

Indiana Algebra Testa. A series of twelve tests which incorporated Monroe's 

Standard Research Tests in Algebra and six tests devised by H. G. Childs of 

Indiana University. Not available for use. 

Reference: Childs, H. G. "The measurement of achievement in algebra," Tfdrd 
Conference on Educational Measurements, (Bulletin of the Extension Divi- 
sion, Indiana University, v. 2, no. 6) 1917, p. 171-83. 
Sample exercises from tests are repioduced and results tabulated. Monroe's and Rugg't tcttt 

are compared. 
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Los AngeleSjTest in 9A Al^elira. This test was devised by a committee of Los Angeles 

high-school teachers. It is based on the work of Rugg and Clark. 

Reference: Second year book of the Division of EducaUonal Research, Los Angdes^ 

California, July, 1919, p. 113. 
The test is reproduced with answers, results and graphs. 

Monroe's Standard Research Tests in Algebra. These tests are based upon the simple 

equation and the steps involved in its solution. There are five tests, one upon each 

of the processes involved and a sixth test requiring a complete solution of a simple 

equation. 

Publisher: Bureau of Educational Measurements and Standards, Kansas State 

Normal School, Emporia, Kansas. 

References: Monroe, Walter S. ''Test of attainment of first-year high school 

students in algebra," School RevieWy 23:159-71, March, 1915. 
This contains an account of the derivation of the tests and their use with high schocd pupfla. 

Monroe, Walter S. "Measurement of certain algebraical abilities," School and 

Society, 1 393-5, March 13, 1915. 

Second and third annual reports of the Bureau of Educational Measurements and 

Standards, 1915-1917, p. 76 ff. 
Results for twenty-five cities are given. 

Rngg and Clark's Standardised Tests in First- Year Algebra. This series includes six- 
teen tests which are intended to measure the ability to do all of the types of exer- 
cises in the work of the first year. 
Publisher: University of Chicago Press, Chicago, lUinois. 
References: Rugg, H. G. "The experimental determination of standards in the 

first-year algebra," School Review, 24 -.37-66, January, 1916. 
The author states, "A report of the mathematics section of the Illinois High School Conference 
of a preliminary investigation for the purpose of: (1) establishing certain methods by which stand- 
arda for measuring the outcomes of a year's instruction in high-school algebra may be constructed; 
(2) stating tentative results obtained in eight Illinois high schools; (3) making certain criticisms of 
the learning and teaching process in algebra." 

Rugg, H. O. and Clark, J. R. "The improvement in ability in the use of the 

formal operations of algebra by means of formal practice exercises," School 

Review, 25:546-54, October, 1917. 

Suggestions and directions for the use of such material in a cooperative experiment in the teach- 
ing of first-year algebra, carried on with a number of p rogressive teachers seeking to improve the 
tfsfhing of the subject. 

Rugg, H. O. and Clark, J. R. ''Standardized tests and the improvement of teach- 
ing in first-year algebra," Schod Review, 25:113-32, 196-213, February- 
March, 1917. 
This final report made to the Illinois ffigh School Conference [includes an account of the 

derivation of their tests. A reproduction (including "verbal problems") and the standardisation of 

the tests. 

Rugg, H. O. and Clark, J. R. Scientific method in the reconstruction of ninth-gjrade 

mathematics. (Supplementary Educational Monographs, v. 2, no. 1, April, 

1918), p. 52-86. Chicago: University of Chicago Press, 1918. 
"In this monograph the authors discuss the design and the construction of standardized tests 
in secondary mathematics and what the standardised testa revealed." 

(To be continued in the April Number) 



A few principals and some teachers in the Little Rock public schools 

have in previous years shown interest in applying scientific 
Department of methods to school work. This year, however, marks the 
Edocatknud beginning of organized effort. Superintendent R. C. Hall 

Measaremento, has been keenly interested in this new phase of education 
Little Rock, for some time, but the great need of a measuring depart- 

Arkansas ment was not fully realized until September 12, 1919, at 

which time the writer was named as Supervisor of the 
Department of Educational Measurements. 

The first and most difficidt problems arising in the organization of the 
new department was that of securing an adequate number of assbtants to 
carry on the work. Although the efforts of the department for the first 
year were to be confined to the fourth, fifth, and sixth grades, the children 
in these grades occupy 72 rooms and are divided into 92 groups. It was 
readily seen that the supervisor, who is principal of one of the grammar 
schools, could do but little of the actual testing%nd scoring of papers. 

Relief came through the organization of a normal class at the Model 
School. This class is composed of twenty high-school graduates, [under the 
efficient supervision of Miss Lulu B. Chase. 

The giving and scoring of test^ is conducted in the following manner: 
A conference is first held between the supervisor of the subject in which the 
test b to be given, the director of tests (Miss Chase), and the Supervisor of 
the Department of Educational Measurements. At thb conference the 
test b selected. Miss Chase gives the normal class a course of training in 
methods of giving the test. When the students are sufficiently trained, they 
give the test in the various schools. The principab and teachers give the 
right of way to these examiners, making it possible usually to complete the 
testing in one day. The test papers are carried back to the Modd School, 
where they are scored by the students and the results tabulated imder the 
supervision of Miss Chase. 

Dwng the present school year tests have been given in reading and 
language. The results have been tabulated and returned to the schoob. 
The principab and teachers of these subjects are doing very good work in 
studying these results, noting failures, seeking causes, and devbing means of 
eliminating defects. We believe that a very great benefit b abo being de- 
rived from thb work by the members of the normal class. These students 
will enter the schoob next year as teachers. They will be familiar with the 
methods of giving, scoring, and interpreting the results of standardized 
tests — a familiarity which wiU be expected of all teachers in the near future. 
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Now that work in educational measurement is passing rapidly from the 
universities to the public schools throughout the country, many superin- 
tendents are looking about for some plan by which departments of measure- 
ments can be put into operation in their school systems. We believe it a 
timely suggestion that the educational joumab ask for and publish reports 
of this type from many places where successful plans are in operation. The 
above plan may not exactly ht any other system, but it is submitted in the 
hope that helpful suggestions may be gleaned from it. 

G. T. HUCKABY 

Supervisor of Educational Measurements 

The JoxTKNAL OF Educational Research has received from Superin- 
tendent H. O. Dietrich of Kane, Pennsylvania, a report 
Use of Retding entitled ''Findings, Statistics, and Recommendations of 
Teste at Reading Status of the Kane Schools as Revealed by 

Kane, Pa. the Administration of Monroe's Standardized Silent 

Reading Tests, December, 1919." 

The editor of this department wishes to take this opportunity to say 
that he is glad to receive such reports and to invite other school men to be 
kind enough to send a copy of such reports as they may issue in either printed 
or manuscript form. 

The limitations of space prevent the publication in full of the report 
submitted by Superintendent Dietrich. Since the value of an educational 
test depends upon the constructive changes which are made upon the basis 
of the information revealed by the tests, his reconmiendations are of especial 
interest and for that reason they are reproduced below. 

Recoicmendations 

"1. That variability be reduced. It is too large. The only variability 
plausible is that of grade seven in rate and grades five, seven, and eight in 
comprehension. Variability between grades and buildings is also too great. 

"2, That the rate of silent reading be increased up to and including 
grade six. 

''3. That comprehension be stressed in all grades. 

"4. That an effort be made to reduce overlapping of grades. 

''5. That mechanics be stressed in the first three grades so that the rate 
of silent reading will be increased. 

''6. That the quick perception and sense content method be used in 
preference to the phonetic in the primary reading. 

"7. That all reading in intermediate grades shall be done under guidance 
of specific purposes. 

"8. That practice in enlarging the span of attention should be given 
in the lower grades. 

''9. That comprehension can be increased by insuring a soimd mechani- 
cal foimdation. 

''10. That the teachers prepare reading exercises for the pupils which 
are not f oimd in r^ular readers. 
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''11. That the teachers conscientiously study the charts, graphs, and 
statistics, and make reports so that they may better be able to study each 
child's case. 

''12. That the individual scores of each child be kept on file so that the 
needy cases may receive attention immediately upon diagnosis of their 
trouble. 

"13. That the individual defects or impediments be noted for each case 
studied. 

"14. That the subject of reading be made a constructive study on the 
part of all teachers.' 



» 



In common with other dties, Boston has faced the problem of increasing 
the salaries of teachers in public schools. The school committee has recently 

published the results of an investigation by Superintendent 
Salary Frank B. Thompson concerning the "Salaries of public 

Increases at school teachers in cities of over two himdred thousand 

Boston population in the United States and in selected cities 

and towns in Massachusetts."^ From a supplementary 
publication we quote the following: 

Principles Underlying Proposed 
Salary Increases 

"The proposed new salary schedule has been prepared by the School 
Committee on the basis of three underlying principles which are fimdamen- 
tal: 

1. Largest proposed increase in salary goes to the lowest paid 
teachers in the service. 

2. Some increase in salary is proposed for everyone in the employ 
of the School Committee. 

3. The amount of proposed increases and the readjustments con- 
form as closely as possible to the supply of teachers. 

"The lowest paid teachers in the Boston service are the kinder- 
gartners and the elementary assistants. Accordingly, they have been 
given the largest increase, both in actual amount and in percent of increase. 
No other rank of teacher is given more. 

"Some increase in salary has been provided for everyone. The nurses, 
school physicians, the attendance officers, and the directors and supervisors 
have all been allowed increases in salaries in the new schedule. In addition, 
the evening school teachers and the teachers in summer review schools will 
hereafter receive more money for their services. Substitutes, emergency 
assistants, employees in the school centers, and clerks in the executive offices 
have not been left out of consideration. A substantial increase is also pro- 
posed for school janitors. In short, the School Committee has consistently 
followed the principle of something for everybody in the new schedule. 

"In the varying amounts of proposed increases for different ranks of 
teachers, the School Committee has recognized that there are inequalities 

> School Document No. 19, 1919, Bostoa Public Schools, November, 1919. 
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in the present schedule, as pointed out by teachers, and has tried to readjust 
some of them. In addition, the School Committee has also taken into ac- 
count the salary schedules, both present and proposed, in other dties. 
Assuming for the moment that living conditions in several dties may be 
identical, teachers are not likely to leave Boston to teach in other dties if 
Boston salaries are equal, or about equal, to salaries in those dties. Since 
comi>arativdy few teachers who resign from teaching go into other occupa- 
tions, the probability of losing teachers to other dties depends on the salary 
there. In establishing the proposed new salaries the School Committee has 
fixed them high enough so that the salaries of teachers elsewhere will not be 
attractive to Boston teachers. Whether the proposed salaries are high 
enough to attract into the profession those qualified by nature and training 
to teach is a question which the Committee has not imdertaken at this time 
to determine fully and condusivdy. It is, perhaps, significant that colleges 
and universities generally, which for the last few years have suffered from a 
falling off in attendance, are now, in some cases, almost overwhelmed by 
the number of students, some of whom will eventually take up the teaching 
profession, and will; imdoubtedly, be attracted thereto by the present general 
movement to increase teachers' salaries." 



S^atuimU AfliBiiiruitliin of BmttatB of 

(£. J. AsHBAUGH, Secretary and Editor) 



Well, what do you tliink of it? Do you appreciate the fact that the new 
JoimNAL 07 Educational Research, the journal you now hold in your 
hands, is our journal, your journal? Do you feel a personal pride in it and a 
personal responsibility for the material that goes into it; for the influence 
which it wields? Do you know that the first issue had not been out a week 
when it brought to your secretary an inquiry concerning membership in the 
National Association of Directors of Educational Research? 

These are questions to which we wish every member of the Association 
would make answer for himself. Say it aloud. See and hear how it soimds 
and then remember that you have covenanted with yourself to give some- 
thing of your time and thought to this publication. We are pledged to the 
idea of organized bureaus of research in city school systems, state depart- 
ments of education, and colleges and universities. We believe that such 
organization is the most efficient means of gathering and evaluating the 
data which are necessary for progress in public education. Each bureau is 
working upon problems peculiar to itself, but many of the data gathered are 
of more than local interest. Let each member feel morally obligated to 
send to Dr. Buckingham, editor-in-chief, or to your secretary within the 
next thirty da3rs, a report on some work he has done. The report need not 
be long. It should be clearly written, presenting a definite problem, con- 
cisely stating the method of procedure and the results. It should be closely 
allied with the work of public school teachers, administrators and super- 
visors. It should give an answer to some question of importance to them 
or show a way of attack which they can use. We are sure you have the 
material for such a report. Will you take the time to put it into shape for 
publication and send it in? By so doing you will at once discharge at least 
a part of your responsibility, will guarantee the success of the Journal, and 
be of real service to education throughout the country. 

What are people thinking of the new Journal of Educational Re- 
search? We believe it will be quite in order to quote from some of the 
letters which reached our desk within a few days after the first number was 
issued. 

''I wish to say that no educational paper has ever appealed to me as 
much as the first copy of the Journal of Educational Research." — An Ohio 
superintendent of schools. 
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"The Journal of Educational Research looks like the best bet in the 
country." — Michigan. 

''I have just received the Journal of Educational Research. It is going 
to give us just what we need." — Iowa. 

These and other communications indicate that those who have seen it, 
like it. But has it occurred to you that one or more of your progressive, 
wide-awake friends may not have seen it yet? Could you do them a greater 
service than to call it to their attention? I want every friend of mine in 
Iowa to get acquainted with it. What about you in your state? 



Director J. C. De Voss of the Kansas State Normal School has sent in 
the following news notes. If you are interested in any of the problems uf>on 
which he is working, write him and thus coordinate your work and get 
greater results. 

"We have given the Army Intelligence Test Alpha to the Freshmen and 
Sophomores of the Kansas State Normal School and to high school students 
of several junior high schools, also to some pupils in the intermediate grades. 
We are preparing a manual to be used with the Army Alpha tests in the pub- 
lic schools. We are also preparing age and grade distributions of the scores 
obtained. We are standardizing a new Latin Derivative test and are making 
good progress in preparing a scale for use in Wood-working in Manual 
Training. 

"One very interesting feature of our work this year is that of extension 
classes among teachers in five cities. I believe this work is sure to grow in 
volume and in importance in Kansas." 



Dr. Ashbaugh and Dr. Greene of the Bureau of Educational Service, 
University of Iowa, have been engaged in two very interesting surveys this 
winter. The one was concerned with the course of study in the jimior high 
school grades and involved the comparison of the relative efficiency of teach- 
ing Latin and Algebra in the eighth and ninth grades. The other was the 
formulation of a constructive building program for a school district in which 
the financial possibilities were only about one-third of the immediate needs. 
This latter study involved a comparison of the assessed valuation of real 
estate and the actual value as shown by sale price. If any reader wishes some 
real enlightenment at the expenditure of a couple of hours' work, it is sug- 
gested that he go to the coimty recorder's office and list the sale price of a 
number of pieces of property and then compare these with the values shown 
on the assessor's books in the auditor's office. 



Editorial QflEke, UriMuiA, niinob Editor-in-chief B. R. Budungfaun, Uiiiv«nity of Dliiiob 
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CONSTRUCTING A LANGUAGE AND GRAMMAR SCALE 

W. W. Charters 

Carnegie Institute of Technology 

Introduction 

In our studies of the efficiency of school children in using correct 
speech, two difficulties were recognized at almost the beginning 
of the investigation. In the correction of language forms upon 
a language level without knowledge of grammatical rules and 
definitions, it was found that few teachers had definite informa- 
tion about the errors which their children made. They recognized 
that errors occurred and that in a general way some were more 
common than others; but any detailed knowledge of exactly how 
such errors should be attacked was almost entirely lacking. This 
lack of definite information prohibited them from making local 
attacks upon specific errors; and this is, in almost all cases, with 
some marked exceptions, true not only of the individual teacher 
but also of whole school systems. For, the tendency is to take 
pot shots at errors and this in spite of the fact that the only 
method of correction is to attack them one at a time and that a 
certain number of errors should be assigned to each grade for 
frontal attack with the supporting assistance of the grades above 
and below. 

It was found also, that the study of grammar seemed to have 
an almost negligible effect upon the correction of errors. A 
steady increase of skill from grade to grade is noticeable before 
grammar is studied but in the grades where granmiar is taught 
and where a rapid increase in skill is expected there did not seem 
to be a greater increase than in the lower grades in which instruc- 
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tion is not given. If tMs is true, then two results must follow. 
Either grammar should be eliminated as a grade subject of study 
or methods should be used by which it will have a noticeable 
effect upon language usage. Very serious doubts as to its use- 
fulness in grades are growing rapidly. But imtil it is clearly 
demonstrated that it 'does not and cannot affect the correction of 
errors, the doubt will not be resolved. 

The probable reason for its failure to fimction as a basis of 
correction is that the educational world has taken the indefensible 
position that incorrect forms must not be placed before children. 
That the verb must agree with its subject in person and number 
is taught in connection with the analysis of correct sentences only. 
For in select educational circles it is considered bad form to place 
on the board sentences such as, "Was you looking for some- 
thing?" or "He don't look well" and ask children to apply the 
rule to their correction. This is probably caused by a confusion 
of thought. It is entirely defensible to argue that the incorrect 
form should not be made conspicuous when memory alone is 
involved. Before the study of the grammatical rule which is 
found broken the pupil may become confused by seeing both the 
correct and incorrect form given equal prominence; but once the 
rule has been taught and memory is reinforced by reason, there 
is every reason for fusing the error and the rule into one experience. 
Only by this process, carried on in the school room, will the 
pupil recognize that rules have any use as correctives. Until 
that is done deliberately and thoroughly, grammar will be con- 
cerned merely with the analysis of correct sentences, and errors 
will live in a world apart. And if this is not done, grammar must 
disappear from the grades. It is difficult at its easiest, and 
because it is difficult, it leads to confusion and probably, as mental 
exercise, does more harm than good. If it can demonstrate its 
utility as a corrective, it may hope to live. Like other vested 
interests it must demonstrate its ability to render service to the 
public. 

Following the realization of the two facts that language errors 
are not attacked methodically and persistently and that granmiar 
does not seem to function, the idea was developed that formal 
tests might be devised which would place information upon both 
these points at the disposal of the teacher. Such tests should 
obviously be diagnostic and should display the ability of the 
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pupils to recognize incorrect forms, to correct them and to give 
the reason for correction where this depended upon rules of gram- 
mar already learned. 

Method 

By language tests are meant those in which the pupil is 
expected merely to recognize the correct form and by granmiar 
tests are meant those in which he can provide in addition, the 
basic rule for correction couched in grammatical terminology. 
To say that "He gave it to me and Mary" is incorrect because it 
is "impolite" or does not "sound right" is not a use of granmiar. 
The granmiatical rule states that the first personal pronoun stands 
last in a series; for only in this latter case is the terminology of 
granmiar used. 

In constructing the language tests several alternatives pre- 
sented themselves. The first form considered consisted of the use 
of alternative forms, the incorrect one of which was to be crossed 
out, as ^^{Was) {Were) you looking for something?^' This form 
could be quickly treated by the pupils and rapidly scored by the 
teacher. But it would not give an accurate display of the normal 
"ability of the pupils to use the correct form. For normally, when 
an individual is about to ask the question, ^'{Was) {Were) you 
looking for something?^' he does not have the two forms in his field 
of attention; if they were both there the hint would be sufficient 
to supplement his memory in the choice of the correct one. 

This form was discarded and the device accepted of stating, 
"In the following sentences some are correct and some are incor- 
rect. On the line beneath the sentence write the correct form." 
It was felt that the pupil would thereby have to make a complete 
and imassisted decision in a situation approximating very closely 
to the conditions of normal speech. 

In the grammar test the same sentences are used but in addi- 
tion space is provided on the right half of the test page for giving 
the reasons for any corrections made. The form is shown in the 
following portion of one of the tests. The complete test has forty 
items. The title and the provisions for general information 
about the class and the pupil are omitted. 

GENERAL INSTRUCTIONS 

After telling the children not to turn the papers over, distribute the 
folders, this side up. Have each pupil fill in the blanks at the top. Then 
say: "Look at the directions while I read them to you." 
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DIRECTIONS: (To be read by the teacher and pupils together) 

*This test is given to pupils who have studied language and grammar 
to tee how well they are able to tell when sentences are right and when they 
are wrong. Now look at the sample below." 

1, 1 told him to go. 



**The plan is to read this sentence over carefully and see if it is right. 
If it is right make a cross on the dotted line below the sentence. The sen- 
tence, 'I told him to go/ is right so we shall make a cross on the dotted line 
below it. Make the cross now." (The teacher should pause to allow time 
for doing this and should pass around the room in the lower grades to make 
certain every pupil understands.) 

'^If the sentence is not right we are to put the words on the dotted line 
below it. Let us try one that is not right." 

2. I told she to go. 



"The right form is *I told her to go.' So we shall write 'her' on the line 
below it." 

"On the right-hand side we are to tell why we make the change on the 
left-hand side. We always begin our reason for the change with the word 
Because. In this case we write — Because 'her* is in the objective case, object 
of the verby told. (The teacher should pause until the pupils write the reason 
at the right of the sentence.) We must not write too large and we may use 
all of the lines on the right-hand side so that we may have plenty of room for 
giving our reasons." 

"We shall now try a third exercise." 

3. It is hisn. 



"The right form is It is his. We make the change Because his is the 
possessive form of the pronoun, he. Fill this in correctly, writing 'his* on the 
line below and beginning the reason on the right-hand side with the word 
Because. Do this now." 

"Remember that if the sentence on the left is all right, we do not need 
to write anything on the right-hand side because we have to make no change 
and so have to give no reason for making a change." 

The teacher should pass around the room and see that the children hll 
these in correctly and when all have finished he should say, "Begin work on 
the exercises below. Stop when you have finished this page and bring your 
paper to me." This is not a speed test so ample time should be allowed to 
each to finish. This test should be completed in two periods during the same 
day. Part I should occupy the first period, and Part II the second. At the 
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begiimini; of the second period, go over the above instructions so far as may 
be necessary before directing the children to begin on Part II. After the 
children have finished Part U, collect the papers. 



1. John went to town. 


1 






2. May Inez and me go? 


2 






3. It teaches a person something 
you may use. 


3 




4. Yous girls play too hard. 


4 






5. When one lives in town they hear 
noises. 


5 








6 






7. Who do you want? 


7 








8 






9. Us boys did it. 


9 






mother. 


10 






11. These books are yotim. 


11 






them. 


12 






13. Are those them? 


13 







Content or the Tests 
From studies made in Kansas City, Detroit, and elsewhere, a 
rather complete list of common grammatical errors in the verba- 
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dm expressions of the children was obtained. These were used 
and selection was made upon the basis of frequency of occurrence. 
The following tests were constructed in duplicate forms. 
I. Language II. Language and Grammar 

Pronouns Pronouns 

Verbs A Verbs A 

Verbs B 

Miscellaneous Miscellaneous 

Each test has forty items, one or two of which are correct, to 
keep faith with the children in conforming to the promise that they 
would find that some of them were correct. The number, forty, 
was determined partly by the size of practicable pages and partly 
by the fact that it gives a comprehensive list of the errors at hand. 
The forty do not include all items as do the tests of the funda- 
mental operations in arithmetic, but all frequently occurring and 
many infrequently noticed errors are included so that for purposes 
of class instruction, where only the commoner ones will be studied, 
as distinguished from individual errors made by only one or two, 
the significant ones are undoubtedly included. Some pupils will 
make other errors but all of sufficient frequency to receive class 
attention are present in the tests. 

For purposes of comparison of efficiency at different times two 
forms of the test (Form I and Form II) are available. The 
forms are alike in that the same types of errors are included in 
each and in the same order but differ in the sentences in which the 
errors are found. 

The language tests are constructed so as to be given from 
grades in to viii or in the high school. The granmiar tests will 
naturally be given only in those grades which studied the 
grammatical facts involved. 

Time Limit 

In giving the tests no time limit is prescribed at present. This 
has been omitted because the sentences necessarily vary in length 
if approximately natural sentences are used; and relative ability, 
as shown by the test, would be greatly affected by speed in hand- 
writing. In the grammar division of the test time conditions 
are further disturbed by the fact that no standardized form for 
stating grammatical rules has been accepted or proposed by the 
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schools. In addition to these considerations opposing the setting 
of a time limit is the further fact that the test being diagnostic in 
character it is essential that all the errors should be attacked by 
each pupil. 

However, in our most recent modification of the language sec- 
tion of the tests we are experimenting with the writing of correc- 
tions by asking the pupils not to write the whoh sentence in correct 
form but to insert, on the line beneath, the correct words} This 
may make it possible to set a time limit on the language section; 
but it does not remove any difficulty in the grammar section. 

Weighting 

A very careful study was made of approximately three thou- 
sand one hundred seventh and eighth-grade test papers on pro- 
nouns to determine the weight of eajch item. The plan followed 
was to determine the number and percent of incorrect replies and 
using sigma (o-) as a basis and 2 . 5o- as zero to give the approximate 
weight to each. Fortunately, it was found that the relative 
ranking of individuals was not appreciably affected by dropping 
the two decimals from the weighted amount and using the nearest 
integer. Furthermore, it was discovered that the correlation 
between rankings determined upon the bases of unequal and equal 
weights for each item was slightly over 0.90. Consequently, it 
was decided to adopt the simple plan of counting each item as 
possessing unitary value. 

It is entirely possible that if zero ability were more closely 
defined than 2 . So- and if it were based on zero third-grade ability 
rather than upon zero seventh-grade skill, as was done in our study 
of the three thousand one hundred cases, the weighting might be 
more significant than has been foimd in the latter case. But for 
diagnostic purposes, which is the professed function of these tests, 
this consideration is not of great significance. 

What was true of the weighting of language skill when based on 
percentages of failure was more noticeable in grammar weightings 
because of the very large percentages of failure to give reason for 
correction. The three thousand one hundred papers examined 
had a median percentage incorrect of over fifty. 

^ The directions reproduced on page 252 above are the ones used in this modifica- 
tion of the original test 
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Scoring 

The scoring of the language section presents no serious diffi- 
culty since the forms tested are those upon which any well- 
infonned teacher is competent to judge. However, scoring cards 
are provided to expedite the work. 

In the grammar section the absence of standardized forms, as 
in addition or multiplication, presents a rather cumbersome 
difficulty. For instance, the sentence ^^Him and I will do it'' was 
written correctiy as "He and I will do it" The reasons given for 
changing to the correct form, Hcy were the following among 
many. 

,, . (1) Because"* H« is in the nominative case, subject of the 
-^ , . verb will do. 

2) Because He is the subject of the sentence. 

3) Because H« is in the nominative form. 

4) Because He is subjunctive form. 

5) Because it would not be right to say Him will do U. 

6) Because we should use He instead of kim. 

7) Because He b the noun. 

8) Because it seems to be turned around. 

9) Because me is objective form, object of the verb and. 

It is obvious that (7), (8), and (9) are absurd and that (5) and 
(6) give no grammatical basis. It is also clear that (1) is a com- 
plete answer consisting of both the description of the case (nomina- 
tive) and the syntactical relation governing it (subject of the 
verb "will do"). The difficulties of the decision of all such cases 
18 seen in (2), (3), and (4). This difficulty arises from the fact 
that they eadi include one of the two parts of the complete answer. 
The second (2) gives the syntactical relation; (3) gives the case 
form and (4) is, probably, a mixture of (2) and (3). 

It was decided that while teachers should naturally expect a 
pupil to give both elements as a standard of class instructions, an 
examiner should rate the answer as correct if one or the other of the 
two elements were given. This would give a more accurate guage 
of ability than would the elimination of (2), (3), and (4). For 
there is no standard form for the answer and if the pupil knows the 
one element he probably knows the second since they are inter- 
dependent, and in any case either one of the two elements affords 
a good clue for practical speech. 
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The norms to be established for these scales will include not 
only the median but, in addition, the 25 and 75 percentile. This 
is necessary in any diagnostic scale. For since it focuses attention 
on the individual, it is obvious that no stimulation will be derived 
from its use by the half of the class above the median if only the 
median is used as a standard. 

The Use of the Tests 

These tests are designed to serve four purposes. In the first 
place, a teacher who gives one of them to his class and has them 
marked and tabulated has a clear idea of the points at which to 
work in the acquiring of language skill, an idea much dearer than 
that afforded by incidental and more or less casual observation. 
In the second place, it is possible by the use of the alternative forms 
to see what progress is made during any period. In the third 
place, they provide a means of discovering whether or not gram- 
mar is of any use in the control of errors, as can be easily f oimd by 
testing freshman students in high school who have and have not 
studied grammar in the grades. Finally it presents ocular proof 
to individual pupils that they do not know how to use certain 
forms with accuracy and ease. 

These tests are still in tentative form and the cooperation of 
those interested is invited for assistance in smoothing out the 
defects and in establishing standards for the grades and the high 
school. Copies of the tests and other information may be obtained 
from the Bureau of Educational Research at the University of. 
Illinois, Urbana, Illinois. 



PSYCHOLOGICAL TESTS AS A MEANS OF MEASURING 

THE PROBABLE SCHOOL SUCCESS OF 

HIGH-SCHOOL PUPILS 

W. M. Proctor 
Ldand Stanford Junior UniversHy 

The validity of the Stanford-Binet Scale, when applied to 
high-school pupils, has already been discussed by the writer in 
the issues of School and Society appearing October 19, and 26, 
1918.^ In those articles it was shown that very significant cor- 
relations had been obtained between intelligence quotients,' 
(I. Q/s), resulting from the individual tests of 107 high-school 
pupils and the school marks earned by the same pupils during the 
school year, 1916-1917; also between I. Q.'s and teachers* 
estimates of intelligence made during the same year. 

Two years and a half later there were 66 of the original 107 
high-school pupils remaining. Teachers who had known all of 
these pupils during their stay in the high school were asked to 
give estimates of their intelligence upon the same rating sheet as 
that which was used in 1916-1917. All school marks earned 
during the two and one-half years were averaged. Correlations 
were then found (a) between Ae I. Q.'s obtained in 1916-1917 and 
the teachers' estimates made in 1919; (b) between the average 
of all school marks earned up to April 1, 1919 and I. Q.'s obtained 
in 1916-1917; and (c) between the average school marks and 
the teachers' estimates made in 1919. Table I shows the close 
agreement between the correlations obtained in 1916-1917 and 
those foimd in 1919. 

Table I shows that the correlations obtained in 1918-1919, 
when the same comparisons were made as in 1916-1917, were 

* Proctor, W. M. "The use of intelligence tests in the educational guidance of 
high-school pupils/' School and Society, 8:473-78, 502-9, October, 19-26, 1918. 

* The intelligence quotient is obtained by dividing the mental age by the chrono- 
logical age. Thus a twelve-year-old, chronologically who tested eight years old 
mentaUy would have an I. Q. of 0.66, expressed for convenience "66." The I. Q. 
is an index of relative brightness. For further discussion of intelligence quotient see: 
Terman, L. M. The inkUigenu of school children, Houghton Mifflin and Co., 1919, 
p. 7. 
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TABLE I. COMPARISON OF CORRELATION OBTAINED 
IN 1916-1917 AND THOSE OBTAINED IN 1918-1919* 



Year 


Correlation 

between I. Q. 

and Teacher 

Estimates 


Correlation 
between I. Q. 
and School 
Marks 

• 


Correlation 

between School 

Marks and 

Teacher 

Estimates 


Total 

Number 

of 

Cases 


/ 


2 


3 


4 


5 


1916-17 

1918-19 


0.586±0.043 
0.583±0.055 


0.545±0.046 
0.487 ±0.063 


0.702±0.033 
0.667±0.046 


107 
66 



* Pearson's formula' (shorter method) was used in making all correlations. 

practically as high as those obtained in the first instance. The • 
results of two and one-half years of follow-up work seem to indi- 
cate that the person who made the original tests with the Stanford- 
Binet Scale in 1916-1917, would have been in a position to give 
very helpful advice to all of the pupils tested by him; also that 
his predictions as to the possible educational future of each of 
these pupils would have deserved serious consideration by parents 
and teachers. 

As a means of discovering individual differences between school 
children in order that they may be grouped in classes according 
to ability, the individual psychological test has been shown to be - 
a helpful tool. From the standpoint of school administration, 
however, the individual test presents serious difficulties. The 
time required to give an individual test to a high-school pupil 
varies from 40 minutes to 120 minutes. The total number of 
pupils that can be examined by a single examiner in a day will 
seldom exceed ten. The use of the Stanford-Binet abbreviated 
scale enables an examiner to test from 15 to 25 pupils in a day. 
Even so, it is impossible to use the individual method when a 
rapid survey of an entire school population is to be undertaken. 

Group mental examinations afford the only means of meeting 
the demand for a speedy and reliable method of measuring the 
mental abilities of large groups of people. Under the supervision 

*Rugg, H. O. Statistical methods applied to education. New York: Houghton 
Mifflin and Co., 1917, p. 274. 
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of Dr. L. M. Terman the writer directed the giving of Examina- 
tion a (Form A) and Examination Alpha (Form 5) of the Army 
Scale to 1,349 high-school pupils, representing eight California 
high schools, during the school year 1917-1918. 

Examination a consists of ten tests: (1) Oral Directions, 
(2) Memory for Digits, (3) Disarranged Sentences, (4) Arith- 
metical Reasoning, (5) Information, (6) Synonym-Antonym, 
(7) Conmion Sense, (8) Number Series Completion, (9) Analogies, 
(10) Number Comparison. The total possible raw score is 237. 
This test was given to portions of the first-year high-school classes 
in the Oakland Technical, Oakland Central and Fremont, Oak- 
land, high schools and to all of the pupils present on the day of the 
examination at the Palo Alto Union High School. The total 
number of pupils was 715. 

Group Examination Alpha consists of eight tests: (1) Oral 
Directions, (2) Arithmetical Reasoning, (3) Practical Judgment, 
(4) Synonym-Antonym, (5) Disarranged Sentences, (6) Number 
Series Completion, (7) Analogies, (8) Information. This test 
was given to all pupils present on the day of examination in the 
San Mateo, Redwood City, Moimtain View, and Santa Clara 
union high schools. The total number of these pupils was 624.. 

These group mental examinations were applied to all of tne 
pupils in each of the high schools enumerated above at exactly 
the same time. A sufficient number of examiners, trained by 
Dr. Terman, were taken to each high school, to cover the entire 
high school in one forty-five minute period. The size of the 
groups ranged from 40 to 1 50. It took the writer and his assistant 
a total of 134 hours to test 107 high-school pupils by the individual 
method. Six trained examiners were able to give Examination a 
to 350 Palo Alto high-school pupils in 45 minutes. The test 
blanks were scored by imiversity students. Their work was 
carefully checked and the results tabulated by the writer. 

I. Group Test Results Compared with 
Individual Test Results 
One hundred and sixteen of the high-school pupils tested with 
Examination a had previously been given the Stanford-Binet 
Scale. Table 11 makes comparison of the two kinds of mental 
examination. Although no Binet I. Q.'s are found in the group 
140-149, six Army Scale I. Q.'s are between 140 and 149. This 
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is because a higher mental age is attainable on the Army Scale 
than on the Binet Scale. For example, a high-school boy fifteen 
years and two months old passed every test in the Stanford-Binet 

TABLE n. RELATION BETWEEN THE I. Q.'S OF 116 HIGH-SCHOOL 
PUPILS EARNED ON THE STANEORD-BINET SCALE AND THE 
I. Q.'S OF THE SAME PUPILS EARNED ON EXAMINA- 
TION a, ARMY SCALE 







I. Q/s on Examination a 


, Army Scale 






I. Q.'s on 

Stanford-Binet 

Scale 


80- 
89 


90- 
99 


100- 
109 


110- 
119 

{Median) 


120- 
129 


130- 
139 


140- 
149 


Totals 


/ 


2 


3 


4 


5 


6 


7 


# 


P 


130-139 










3 
7 


3 
9 


5 
1 


11 


120-129 






1 


3 


21 


110-119 {Median) 




2 


8 


U 


9 


2 




32 


100-109 






13 
11 


3 
8 


4 






20 


90-99 




7 
5 






26 


80-89 










5 


70-79 


1 












1 


















Totals 


1 


14 


^Z 


25 


23 


14 


6 


116 



Median for Binet I. Q.: group, 110-119 
Median for Army Scale I. Q.: group, 110-119 
Correlation, Pearson's formula, 0.736; P. £., 0.029 

Scale, thus earning a mental age of nineteen years and six months, 
and an I. Q. of 129. On the Army Scale, Examination a, he made 
a raw score of 219, corresponding to a mental age score of twenty- 
one years and eleven months, and an I. Q. of 144.^ In other 
words, the Stanford-Binet Scale does not give the superior high- 
school pupil an opportimity to earn as high an I. Q. as he can 
earn on the Army Scale. This factor would tend to lower the 

^ Mental age norms for both tests of the Army Scale were worked out by Dr. 
Samuel Kohs and the writer. It was found that about fifteen points on Examination a 
and twelve points of raw score on Examination Alpha corresponded roughly to a 
mental age year. Possible raw score, Examination a, 237, possible mental age twenty- 
three years; possible raw score, Alpha 212, possible mental age twenty-four years 
and nine months. 
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correlation between the two sets of I. Q.'s. The correlation 
obtained in Table II (+0.736) is a strong indication that if the 
Stanford-Binet Scale is a valid means of finding the mental level 
of high-school pupils, the Army Scale Examination a is also 
valid for the same purpose. 

II. Army Scale Results Compared with 
High-School Marks 

The school work of all the high-school pupils examined by 
means of the two army group tests was carefully followed up for 
the school years 1917-1918 and 1918-1919. The marks given 
were reduced to a comparable basis by assigning arbitrary values 
to each tj^e of mark employed by the various high schools. Thus 
an "A" or a"l" was given a value of 95; a "B" or a "2," a value 
of 85, etc. Letters or numbers with plus and minus signs were 
given intermediate values. All of the marks earned by a given 
pupil were averaged, but no case was included in the tables 
unless the marks for at least two semesters of school work, the 
equivalent of one year, were available. 

1. Army Scale, Group Examination a. — Table III makes a 
comparison between the I. Q.'s obtained from the Group Examina- 
tion a and the quality of high-school work of 494 high-school 
pupils. The totaJ nimiber taking the test was 715, but only 494 
cases had ratings for one year of school work. 

Since the correlation obtained (-1-0.343) is 12.8 times the 
indicated P. E., it has considerable significance. While it is 
not as high as the correlation between Binet I. Q.'s and school 
marks found in Table I, there are several factors which may have 
tended to lower the correlation. The army tests were designed 
for use with soldiers in cantonments. Many of the questions 
have to do with matters of conmion knowledge about a military 
camp, but with which high-school pupils have no acquaintance. 
This would especially affect the scores of high-school girls. There 
are twenty cases falling in I. Q. groups below 95, where the 
indicated school work is of a quality of 80 percent or above, and 
fifteen of these cases, or 75 percent, are girls. 

Another factor which may have tended to lower the correla- 
tion is the skewness of the school marks curve toward the high 
percents. The median school marks group in Table III is 80-84. 
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TABLE m. COKSELATION BETWEEN THE I. Q.'S O? AKUY OKOXTP 

EXAMINATION fl AND THE QUALITY OF SCHOOL WOEK 

OP 494 HIGH-SCHOOL PUPILS 









Marks 


84 or 
Lower 


85- 
89 


90- 
94 


95- 
99 


100- 
104 


105- 
109 

median) 


110- 
114 


llS- 

119 


120- 

124 


125 or 
Above 


rotala 


I 


' 


3 


« 


S 


« 


r 


i 


# 


li 


" 


K 








3 

5 


2 
9 


2 

18 


3 
24 


6 
22 


6 

24 


6 

8 


6 
4 




















80-&4 iHt- 
dian)--.. 


1 


2 


9 


28 


41 


46 


30 


13 


9 


3 


182 


75-T9. . . . 
70-74. . . . 


1 
2 


,1 
3 


9 
4 


19 

14 
4 


19 

11 
t 


19 
1 


19 
7 
2 




2 




98 
54 


































Totals. . . . 


4 


9 


31 


U 


92 


105 


86 


52 


20 


13 


494 



Medians: I. Q.'s group, 105-109; school marks, group 80-84 
Semi-interquartile ranges: I, Q.'s, 6 points; school marks, 4>^ percent 
Correlation, Pearson's formula, 0.343; P. E., 0.027 

This represents a grade of "B" or "2." It is necessary for these 
high-school pupils to receive marks of "B" or "2" in all subjects 
required for university recommendation. The Palo Alto high 
school is in close pronmity to Stanford University, and the 
Oakland high schools are in the immediate vicinity of the Univer- 
sity of California. The fact that 68.8 percent of the grades 
given to these 494 high-school pupils were "B" or above is an 
indication that teachers were influenced in their marking by the 
demand for "B" grades for university recommendation. Many 
pupils with just average ability were given marks ranking superior. 
Hence there would be a rather wide difference between their 
mental ability as shown by the tests and their school progress as 
shown by their marks. 

2. Army Scale, Group Examination Alpha. — Table TV com- 
pares the I. Q.'s of 480 of the high-school pupils of San Mateo, 
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Redwood City, Mountain View, and Santa Clara with their school 
marics. There were 624 pupils beloDging to these high schools 
who took Examination Alpha, but only 480 cases came under 
the rule requiring ratings for one whole year of school wo^. 

TABLE IV. COBSELATION BETWEEN THE I. Q.'s OF THE ASHY 

GBOUP EXAMINATION ALPHA AND THE QUAUTY OF 

SCHOOL WORK OF 480 HIGH-SCHOOL PXJPILS 







UphaLQ's. 






School 
Mukt 


S4or 
Lower 


85- 


90- 


95- 


100- 
lOt 


105- 
109 


110- 
114 


115- 
119 


i2&- 
m 


125 or 
Above 


Tot^ 


i 


1 


J 


4 


s 


4 


1 


1 


« 


» 


n 


12 


90 or over 








3 
8 
6 


17 
22 


15 
IS 
21 


12 
24 
20 


9 
13 
10 


9 
5 


5 
6 
1 














»-M 






4 


S9 


75-79 (JTe- 






J 


25 


33 


23 


10 


7 


4 




log 


70-74 




4 
3 


10 
3 
2 


18 
12 
5 


14 

7 


22 

S 

1 


12 
8 

1 


I 


1 






6S-W 


1 




55-64 






















ToWk 


1 


7 


26 


77 


99 


105 


S7 


41 


25 


12 


480 



Medians: I. Q.'s group 105-109; tdipd nuAi, groups 75-79 
Semi-interquartile ranges: I. Q.'s, 6 points; school marlu, 6}i percent 
Correlation, Pearson's formula, 0.413; P. E., 0.026 

The correlation obtained in Table IV (+0.413) is 15.9 times 
the indicated P. E. and 0.07 higher than the correlation found 
in Table m. The higher correlation found in this table may be 
due to the fact that Examination Alpha was the result of careful 
revision of the first series of tests in the light of preliminary 
experimentation in three army cantonments and the returns 
from the tests of several thousand school children. Also, the 
high schools in which Examination Alpha was applied were not 
in such close proximity to universities as were die high schools 
represented in Table m. The group median for school marks 
is 75-79, and only 48.8 percent of the ratings given in these four 
high schools ranged as high as "B" or over. 
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When account is taken of the possible reasons for the difference 
in the correlations as shown in Tables HE and IV, it is safe to 
say that they are of approximately equal value. For use in the 
public schools Examination Alpha is the better scale, because it 
consbts of but eight tests, can be given in less time, is scored 
more rapidly, and costs less to print. 

III. Individual and Group Mental Tests as Means 07 
Indicating Probable Retention or Elimination of 

High-School Pupils 

1. Elimination among pupils tested with the Stanford-Binet 
Scale. — On the first day of April, 1919, it was found that 41 of the 
original 107 pupils tested in 1916-1917 with the Stanford-Binet 
Scale had dropped out of school, leaving 66 still in attendance. 
Table V gives the distribution of the 107 cases, showing the 
I. Q.'s of pupils who left high school to go to work, of pupils who 
were transferred to other high schools, and of pupils who still 
remain in the same high school. 

TABLE V. distribution ON APRIL 1, 1919, OF 107 
high-school pupils tested with STANFORD- 
BINET SCALE IN 1916-1917 



Binet I. Q.'s 
Earned in 
1916-1917 


Total Number 
of 
Cases 


Distribution April 1, 1919, t 


>y Percents 


Out at 
Work (%) 


Out.Transfer'd 

to Other ffigh 

Schools (%) 


Remaining in 
Same High 
School (%) 


1 


2 


3 


4 


5 


79 or lower 

80-89 


1 

7 
29 
27 
22 
15 

6 


100 

72 

31 

22 










14 
9 
22 
27 
13 
33 




14 


90-99 


60 


100-109 


56 


110-119 


73 


120-129 


87 


130 or above 


67 


No. of cases 


107 


21 


20 


66 


Median I. Q.'s 


• 


94 


110 


110 
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The only pupil testing bdow 80 I. Q. droi^>ed out at the end 
of the first semester of 1916-1917 to go to work. All of those in 
group 80-89 who left school to go to work, did so by the end of the 
first year. Failure in school work has been recognized as the 
most fruitful cause of elimination from high school, but the 
relation between mental ability and failure in school work has 
not heretofore been given due consideration. At the end of two 
and one-half years none of those testing below 80, and only 28 
percent of those testing 80-89 remain in high school. On the 
other hand, 100 percent of those testing 110 or over are pursuing 
their studies either in the Palo Alto high school or in other high 
schools. When the average school ratings of the different groups 
is taken into account the close connection between mentality 
and elimination will be still more apparent. The average school 
rating of the 21 who left school to go to work was 73 percent; of 
the 20 transferred to other high schools, 77 percent; and of the 
66 remaining in the Palo Alto high school, 79 percent. 

2. Elimination among pupils tested with the Army Examination 
. a and Alpha. — Only five of the eight high schools where the Army 
Scale was applied were selected for follow-up work in connection 
with elimination because the records of the three Oakland high 
schools did not indicate whether the pupil leaving had been 
transferred to another high school or had gone to work. In the 
case of the Palo Alto, San Mateo, Redwood City, Moimtain View, 
and Santa Clara high schools, it was comparatively easy to secure 
reliable data with reference to every pupil who took the test. 
The principals of all these schools had served in their respective 
positions from four to fourteen years, knew their pupils thorough- 
ly, and had on record information concerning the movements 
of those who had left school since the giving of the army tests 
in 1917-1918. 

Table VI gives for those tested with the Army Scale a distri- 
bution similar to that contained in Table V for the 107 tested 
with the Stanford-Binet Scale. The 955 pupils of the five high 
schools above mentioned have been distributed by I. Q.'s into 
four groups: (1) those who left high school to go to work, (2) 
those who transferred to some other high school, (3) those who 
graduated, (4) those remaining in high school on April 1, 1919. 
The follow-up work covered one and one-half years of school 
work. Figure 1 illustrates graphically the data of Table VI. 



AprU, 1920 



PSYCHOLOGICAL TESTS 



267 



TABLE VI. DISTRIBUTION OF 955 HIGH-SCHOOL PUPILS ON 

APRIL 1, 1919, WHO WERE TESTED WITH ARMY 

SCALE TESTS IN 1917-1918 BY L Q. GROUPS 





Total 
Number of 
Cases 


Distribution on April 1, 1919, by Percents 


Anny Scale 

I. Q.'s Earned 

1917-1918 


Out at 
Work 

(%) 


Out, Trans^ 

f erred to Other 

High School 

(%) 


Out by 
Graduation 

(%) 


Remaining in 

Same High 

School (%) 


/ 


2 


3 


4 


5 


6 


79 or lower 

80-89 

90-99 


13 
73 
202 
283 
221 
101 
62 


61.5 

34.3 

26.2 

12.3 

4.0 

6.9 

1.6 


7.7 
8.2 
8.9 
8.8 
14.5 
11.8 
9.8 


0.0 
5.5 
11.4 
14.1 
23.0 
19.8 
24.6 


30.8 
52.0 
53.5 


100-109 

110-119 

120-129 

130 or over 


64.8 
58.5 
61.4 
64.0 


No. of Cases . . 


955 


138 


100 


153 


546 


Median I. Q.*s. 




96 


110 


111 


107 


Percent I. Q/s 
below 100... 




62.4 


25.0 


17.6 


26.5 






FIGURE 1. ILLUSTRATING TABLE VI 




!.).*■ 



79 or 

lower 



80 • 89 90 



. 99 100-109 110-119. 120-129 130- or 

« abov* 

Out "at work*. I38 cancQ 
• • transfer- » 100 



♦ ♦♦♦♦ ♦♦♦♦ 



•gradual Ipn", 153 
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In this table there i^pears to be a strong confirmation of the 
findings of Table V, as the following comparison will show: 

TABLE VIA. MEDIAN I. Q.'s BY GROUPS 





Oat at Woik 


Oat, Transferred to 
Other Hi^ School 


Remaining in 
Same Hi|^ School 


/ 


2 


J 


4 


TmbleV 


94 
96 


110 
110 


110 


TmbleVI 


107 






TABLE VIB. PERCENT OF PUPILS IN EACH GROUP 
WHOSE I Q.'s WERE BELOW 100 




Oat at Work 


Out, Transferred to 
other ffigh Schoob 


Remaining in 
Same ffi|^ School 


i 


i 


J 


4 


Table V 


71 A 
62.4 


20.0 
25.0 


27.0 


TabkVI 


26.5 







The agreement between the two tables is the more striking 
when it is remembered that the 107 high-schools pupils of Table V 
were all first-year pupils when the tests were given, while the 955 
pupils of Table VI comprise all the classes of five different schools. 

The tendency, noted in the discussion of Table II, for girls 
to make lower scores on the Army Scale than boys accounts for 
the 5.5 percent of pupils with I. Q.'s of 80-89 who appear in the 
"out by graduation" group. These four pupils were aU girls, 
and their average rating in school work was 83 percent. 

Table VII indicates how school marks tend to correspond to 
mental level as indicated by I. Q.'s earned in the Army Scale tests. 

Considering the "at work" cases, it appears that only the 
three highest I. Q. groups were doing a passing grade of work. 
Lack of mental ability was perhaps the most potent cause of 
elimination, but it was not the only cause operating in these 
cases. When interest in the subjects offered, application, and 
ambition are lacking, high scores in the mental tests are n 
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TABLE Vn. AVERAGE SCHOOL MARKS OF 955 HIGH-SCHOOL PUPILS, 
DISTRIBUTED ACCORDING TO THE CAUSES OP LEAVING 



Cause of Leaving 


79 

I. Q. or 

Lower 


80- 

89 

LQ. 


90- 

99 

LQ. 


100- 

109 

LQ. 


110- 

119 

LQ. 


120- 

129 

LQ. 


130 
I. Q. or 
Higher 


General 
Average 


/ 


2 


3 


4 


5 


6 


7 


s 


9 


At work 


65 
59 


64 
67 
83 


72 
76 
79 


66 

72 
84 


70 
82 
85 


75 
85 
84 


87 
86 
92 


71.3 


Transferred 

Graduated 


75.3 
84.5 








Average marks by 
I. Q. groups 


62.0 


71.3 


75.6 


74.0 


79.0 


81.3 


88.3 


77.3 



necessary guarantee of school success. Turning now to the 
pupils transferred to other high schools, it appears that they made 
better average marks imder every I. Q. group, except the very 
lowest, than did the ^'at work" pupils; but it is evident that 
some of them transferred to other high schools because of failure 
in school work. Later checking up will no doubt find them out 
of school entirely. All of the cases in the "out by graduation" 
group show high average school marks, even those whose I. Q. is 
between 80 and 89. These are the same four cases discussed in 
connection with Table VI. They illustrate how necessary it is 
for those employing mental tests to be conservative in accepting 
the results of any single test as final. 

When the school marks earned by all of these "out" groups 
are averaged a series of marks is obtained, ascending gradually 
from the lowest to the highest I. Q. ratings, which indicates a 
definite tendency for the quality of school work to correspond to 
the mental level indicated by the Army Scale tests. 

A further following up of the 153 who graduated from the five 
high schools between September, 1917 and April, 1919, brought 
out the fact that 94 of them were continuing their education in 
college, university, or normal school. The median I. Q. of those 
going on to higher educational institutions was found to be 116. 
One high-school girl, who earned an I. Q. of 140 on the Army 
Scale, graduated from the San Mateo high school at the age of 
fourteen years and five months. Because of the minimum age 
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limit of fifteen years for entrance to the university, she was com- 
pelled to wait seven months before continuing her education. 
Had her case been included in the ''at college" group, the median 
I. Q. would have been 118. 

Taking into accoimt all of the cases of high-school pupils 
tested either by the individual or group method of mental exami- 
nation we find. the following ascending scale of median I. Q.'s as 
a further indication that the psychological tests disclosed the 
approximate mental level of the cases discussed in the foregoing 
tables: first-year high-school pupils, median I. Q., 105; high- 
school graduates, 111; those going on to college, 116. 

Summary 

1. Individual and group mental tests of the types describe d 
have been shown to be sufficiently reliable to justify their use as 
aids in determining the mental level of high-school pupils. 

2. Group tests, such as Army Scale Examinations a and 
Alpha, make possible a preliminary mental survey of an entire 
high-school population at the beginning of a school year. The 
resulting raw scores will be foimd to be of great value in grouping 
the pupils according to ability. Such tests should always be 
supplemented with every other possible means of discovering 
the mental level. The results should be considered tentative and 
subject to revision in the light of later developments. 

3. The high-school principal who makes such a preliminary 
mental survey of his pupils can be reasonably sure that 50 percent 
of those who test below normal will be eliminated within the 
first two years; that 25 percent additional of the subnormal 
group will have been transferred to other high schools because of 
failure in their school work; and that a negligible nimiber will 
ever graduate. With this information at hand he can plan the 
curriculums of his pupils more intelligently. Discovering at the 
outset that from 15 to 30 percent of his pupils are incapable of 
succeeding in the conventional high-school subjects, he will 
undertake to make new adjustments to meet the situation. There 
will be fewer failures; more pupils will remain to take work that 
is adapted to their needs and capacities; and the high school will 
be less open to the charge of catering only to the intellectual 
aristocracy among its pupils. 



RETARDATION IN ONE^ROOM RURAL 
SCHOOLS IN KANSAS 

F. J. Kelly, University of Kansas 

AND 

A. K. Looios, Principal, Sumner County High School, Wellington, Kansas 

In 1918 Kansas still had 147,889 children enrolled in one-room 
rural schools out of a total of 405,319 children enrolled in all 
public schools. Of those in one-room schools about 72 percent 
were enrolled in schools having terms of seven months and almost 
all of the remaining 28 percent in schools having terms of eight 
months. The course of study in all these one-room rural schools 
is made out on a nine-year basis; and, if the children keep up with 
their classes, they are therefore still required to spend nine years 
to complete the course. Practically all schools in the towns and 
dties, on the other hand, have terms of nine months. The study 
here reported was one of a group of studies undertaken in the 
hope of reducing this inequality of opportimity. 

In February, 1917 with the cooperation of the state superin- 
tendent and the coimty superintendents concerned, pupil's cards 
containing the following questions were sent to the teachers of 
all one-room rural schools in fourteen typical coimties in Kansas. 

PUPIL'S CARD 

1. Are you a boy or a girl? 

2. What is your name? 

3. How old were you at your last birthday? 

4. In what month were you bom? 

5. In what year were you bom? 

6. In what grade are you now? 

7. Do you take all your studies in the same grade? 

8. Have you ever attended any other school? 

9. Does your father own the farm on which you live? 

10. Do you intend to go to high school? 

11. If you are a boy, do you intend to be a farmer? 

A sufficient supply of the cards was sent so that each teacher had 
one for each pupil in her school. 

Along with these cards, the following teacher's card was sent: 
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TEACHER'S CARD 

1. County 

2. DistnctNo 

3. Teadwr's name 

4. Teadwr's address 

5. How many painb are NOW on roU? 

(Do not f^Yt enrollment from first of the year) 

6. Have you rTamined every pupil's card in regard to the three points 

mentioned in the directions for the teacher? 

7. How many months of school does this district have this year? 

8. How many months oi school did this district have last year? 

9. How far is it from this school house to the nearest high school? 

10. How many years have you tau^t this school before this year? 

11. What is your monthly salary? 

12. State exactly what kind of certificate you hold 

13. How many years of teadiing experience have you had before this year? 

14. Are you a high-school graduate 

15. If not a hi^-school graduate, how many weeks have you attended 

high school? 

16. Have you attended a state normal school? 

17. If so, how many weeks? 

18. Have you attended a college or university? 

19. If so, how many weeks? 

(over) 

On the reverse side of the teacher's card the following 
instructions were printed: 

TEACHER'S CARD {Reverse Side) 

To the teachers of one-teacher rural schools: 

With the approval of State Supt. W. D. Ross and Mr. J. A. Shoemaker, 
one of the Rural School Supervisors, I am undertaking to make a study of 
certain conditions in the one-teacher rural schools of Kansas. Your county 
superintendent is heartfly in favor of the plan and I am certain that you will 
be willing to let the children fill out the enclosed cards at your first oi^>or- 
tunity. The information that I have asked for on the teacher's card is very 
important. The teacher's card is printed on the other side of this sheet. 

If you will assist in this study, please notice the following directions 
carefuUy before letting the children fill out the cards. 



DnuEcnoNS for the Teachers 

Let the children fill out the cards if they are old enough to do it correctly, 
otherwise please fill them out yourself. If you haven't received enough 
cards for all pupils use the cards for the older pupils, but fdease report the 
sex, name, age, and grade of every pupil for whom you send in no card. 
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Examine the cards after the children have filled them out to make cer- 
tain of the following three points: 

1. That every question has been answered. 

2. That the answer to question three agrees with the answers to ques- 

tions four and five. 

3. That question six is answered correctly. 

N. B. IN ANSWERING QUESTION SIX, COUNT A PUPIL WHO 
TAKES HIS WORK IN MORE THAN ONE GRADE IN THAT GRADE 
IN WHICH HE TAKES MOST OF HIS WORK. 

Please fill out your own card carefully, answering every question. 
Return the cards to me in the enclosed stamped envelope within a week 
from the time you receive them if possible. 

Very truly yours, 
1110 Vermont St. A. K. Looias 

Lawrence, Kansas. 

(over) 

It seems sure from these detailed instructions that the data 
given by the children were thus rendered reasonably accurate. 

Of the fourteen counties, eleven sent in returns in time to 
be tabulated for this study. Of all the teachers of one-room 
rural schools in these eleven coimties 54 percent sent in reports 
of all their children. The range of schools responding was from 
30 percent in one county to 81 percent in another. The total 
nimiber of pupil's cards received was 10,298, of which 5,267 were 
boys' cards and 5,031 were girls' cards. All the tabulations from 
these cards were made by Mr. Loomis and not by the teachers 
concerned. 

Among the questions which the study undertakes to answer are : 

1. What is the percentage of seven-month one-room schools 
and eight-month one-room schools by coimties? (See Fig. 1.) 

2. What is the amoimt of retardation in these one-room rural 
schools by coimties, by ages, by grades, and by sexes? (See Figs. 
2, 4, and 6.) 

3. How does this retardation compare with retardation in 
city schools in Kansas? (See Figs. 3, 5, and 7, and Table II.) 

4. How does the retardation in seven-month schools compare 
with the retardation in eight-month schools? (See Fig. 8.) 

5. What is the cost of this retardation in terms of ambition 
for higher education? (See Fig. 9.) 

6. What percentage of the children have spent their school 
lives in one school only, and what effect has the moving from one 
school to another had upon retardation? (See Figs. 10 and 11.) 
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7. What is the money cost of retardation in one-room rural 
schools? (See concluding paragraph.) 

8. What is the money cost of the nine-year course of the ooe- 
loom rural school as compared with the dght-year course of the 
city school? (See concluding paragraph.) 

The answers to the above questions are largely contained in 
the tables and figures given on the following pages. 

TABLE I. THE NDMBES AND PERCENT OF SCHOOLS REPORTING, 
AND THE TOTAL CARDS RECEIVED BY COUNTIES 



No- of ane-ioom rural 

itboob 

No. o[ schools reporting . 
PCRKlit of schools reporting 
No. of boys' cords icc'd 
No. of ^Is' cards nc'd. 



Total no. of caidi rcc'd . 



FIGURE 1. PERCENT OF PUPILS WHO ARE IN EIGHT-UONTH 
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Figure 1 should be read : County £ has 6 percent of its children 
for whom cards were received in eight-month schools, while 
County H has 54 percent in eight-month schools. The average 
of the eleven coimties is also shown. Twenty-eight percent of 
the one-teacher rural schools of the whole state have an eight- 
month term. Practically all others have seven-month terms. 



FIGURE 2. RETARDATION AND ACCELERATION IN 54 PERCENT 

OP THE ONE-TEACHER RURAL SCHOOLS IN ELEVEN COUNTIES 

IN KANSAS, ENROLLING 10,298 CHILDREN 
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Figure 2 should be read: County M has a retardation of 30 
percent and an acceleration of 6 percent. The average of the 
eleven counties is shown, also the average for twelve cities in 
Kansas in June, 1916. Normal age in grade i is six or seven at 
the end of school; grade n, seven or eight; grade m, eight or nine. 
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FIGURE 3. RETARDATION AND ACCELERATION IN TWELVE 
CITIES IN KANSAS, ENROLLING 28,443 CHILDREN 




Ae 30.6 



Cub/5.0 



Figure 3 should be read: City P has a retardation of 12.8 
percent and an acceleration of 18.5 percent. The average of the 
twelve dties is shown, also Cubberley's estimate of the condition 
under a properly adjusted course of study. The high school is 
included in aU except N and O. Normal age in grade i is 6 or 7 ; 
grade n, 7 or 8; grade in, 8 or 9, etc. 

FIGURES 4a and 4b. RETARDATION AT EACH AGE FROM EIGHT 

TO FIFTEEN IN THE ONE-TEACHER RURAL SCHOOLS IN 

ELEVEN COUNTIES IN KANSAS 
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Figure 4a. Boys 
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Figure 4b. Girls 
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Figures 4a and 4b should be read: 24 percent of eight-year-old 
boys are retarded and 19 percent of eight-year-old girls. The 
average for these ages is also shown. 

FIGUKES 5a AMD 5b. KETASDATION AT EACH AGE FROM EIGHT 

TO EIGHTEEN IN TEN CITIES IN KANSAS, 
ENROLLING 26,608 CHILDREN 
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Figure 5a. Boys 
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Figure Sb. Girls 



Read Figures 5a and 5b as follows: 16.1 percent of eight-year- 
old boys are retarded, 9.8 percent of eight-year-old girls are 
retarded. 

FIGURES 6A AND 6B. RETARDATION IN THE DIFFERENT GRADES 

OF THE ONE-TEACHER RURAL SCHOOLS IN 

ELEVEN COXTNTIES IN KANSAS 



} 


safe 


;j 


32 


m 


30 


Vf 


46 


V 


91 


Vl 


99 


VII 


49 


Yni 


94 



nr 41 



Av. 4Z 



^■i ■ ■ ■=; ass 



2S% 50% 

Figure 6a. Boys 
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Figure 6b. Girls 

Figures 6a and 6b should be read: In grade in 39 percent of 
the bojrs are retarded and 30 percent of the girls. The average 
for all grades is also shown. 

piGURES 7a and 7b. retardation in the different grades 

OF THE ELEMENTARY SCHOOLS IN TWELVE 

cities IN KANSAS 
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Figure 7a. Boys 






Figure 7b. Girls 
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Figures 7a and 7b should be read: In grade in 32 . 1 percent 
of the boys are retarded, and 23 . 4 percent of the girls are retarded. 



TABLE n. COMPARISON OF ONE-ROOM RURAL SCHOOLS AND CITY 

SCHOOLS IN RESPECT TO THE PROPORTION OF PUPILS 

RETARDED ONE YEAR AND MORE THAN ONE YEAR 



One-Room 

Rural 

Schools 



aty 

Schoob 



Percentage letftided one year 

B<v» 

Giris 

Total 
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FIGURE 8. RETARDATION IN THE SEVEN-MONTH SCHOOLS 

COMPARED WITH RETARDATION IN THE 
EIGHT-MONTH SCHOOLS 
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Figure 8 should be read: 36 percent of boys attending eight- 
month schools are retarded, while 47 percent of boys attending 
seven-month schools are retarded. 
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FIGURE 9. PERCENT OF NORMAL AND ACCELERATED CHILDREN 

WHO DO NOT INTEND TO GO TO HIGH SCHOOL COK- 

PARED WITH PERCENT OF RETARDED CHILDREN 

WHO DO NOT INTEND TO GO TO HIGH SCHOOL 
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Figure 9 should be read : 37 percent of normal and accelerated 
boys do not intend to go to high school, 46 percent of boys who 
are retarded one year do not intend to go to high school, etc. 
Included in this comparison are 3,990 children twelve years old 
or older. 

FIGURE 10. RETARDATION AMONG THE CHILDREN OF 

LANDOWNERS COMPARED WITH RETARDATION 

AMONG THE CHILDREN OF TENANTS 
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All children twelve or thirteen years of age who have attended 
only one school are included in this comparison. Figure 10 should 
be read: 49 percent of twelve and thirteen-year-old boj^s whose 
fathers own farms are retarded, and 51 percent of those whose 
fathers are tenants are retarded. 

The comparison is based on children who have attended only 
one school in order to exclude from consideration at this point 
the effect of changing from one school to another. Twelve and 
thirteen-year-old children were used to avoid a fallacy resulting 
from using children of all ages. It is evident that the average 
age of all children who have attended only one school and whose 
fathers are tenants is less than the average age of all children who 
have attended only one school and whose fathers own farms. 
This follows from the fact that among children of tenants the 
proportion who have attended but one school decreases with the 
age of the children much more rapidly than it does among children 
of farm owners. Since retardation increases rapidly with age, 
the children of tenants fallaciously seem less retarded than the 
children of landowners when children of all ages are included. 

FIGURE 11. RETARDATION AMONG CHILDREN WHO HAVE 

ATTENDED ONLY ONE SCHOOL COMPARED WITH 

RETARDATION AMONG CHILDREN WHO HAVE 

ATTENDED MORE THAN ONE SCHOOL 



Boys 61 

Girh 34 
Girls 55 



ATTEHDZO OHLY OHZ SCHOOL 



ATTE 



NDEDflORE 



ATT 



ATTENDED MOHE 



THAN ONE 



ENDED ONLY OHE SCHOOL 



SCHOOL 



THAN OUE [school 



25% 



50% 



75% 



All children twelve or thirteen years of age whose fathers are 
tenants are included in this comparison. Figure 11 should be 
read: 51 percent of twelve and thirteen-year-old boys who have 
attended only one school are retarded, and 61 percent of those 
who have attended more than one school are retarded. 
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The Money Cost 

There remains the task of calculating the costs of retardation 
and of conducting seven and eight-month schools for nine years. 
Attention is first called to the significance of a few of the main 
points involved. 

Let it be understood that in figuring retardation exacUy the 
same blank was used in dty schools and coimtry schools, so that 
the data are entirely comparable. We wish to repeat, however, 
that country-school children are considered of normal age for 
grade, if they complete the elementary-school course before they 
have become sixteen, while dty children are regarded as one 
year retarded when they complete the elementary-school course 
at fifteen. It is clear, therefore, that country-school children 
from the first grade through the ninth have progressively a larger 
part of a year the advantage of dty children before being dassified 
as retarded. In spite of this fact, it is noted that coimtry children 
have 8 percent greater retardation as a whole than dty children. 
Not only is that true but this difference is much greater than 8 
percent among the upper ages. For example, while 51 .9 percent 
of fifteen-year-old dty-school boys are retarded, 71 percent of 
fifteen-year-old coimtry-school boys are retarded, and while 42 . 7 
percent of fifteen-year-old dty-school girls are retarded, 65 percent 
of fifteen-year-old country-school girls are retarded. It should 
be noted, however, that the difference is less than 8 percent when 
the ninth grade of the rural school is compared with the eighth 
grade of the dty school. This indicates that the elimination is 
very much greater in the coimtry school than in the dty school. 

Attention is also directed to the fact that while 31 percent of 
all children in eight-month schools are retarded, 42 percent of all 
children in seven-month schools are retarded, a difference of 11 
percent. This means that of the present enrollment in one-room 
rural schools in Elansas, practically thirteen thousand are retarded 
in seven-month schools who would not be retarded if they were 
in dght-month schools. Inasmuch as only 37 percent of boys of 
normal age for grade of twelve years of age or above do not 
intend to go to high school, whereas 46 percent of those retarded 
for one year and 61 percent of those retarded more than one year 
do not intend to go to high school, the rdationship between 
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The tests have been given to about twenty-five hundred 
public school children (June, 1919) in the first three grades;* 
also to 64 '^children" with a mental age on the Stanford-Binet 
Scale of between six and eight in the state school for the feeble- 
minded in Minnesota. Many of the school children tested had 
been previously "Bineted." 

2. Methods, — ^The writer has used three methods for arriving 
at a conclusion concerning the validity of the scale. (1) One 
hundred and twenty children who had been "Bineted" were 
divided into five groups on the basis of their Intelligence Quo- 
tients (I. Q.'s) as determined by their scores in the Binet Scale 
(Stanford Revision). The scores of these groups in the Primer 
Test were then examined for consistency with the groupings 
according to the Binet ratings. (2) Three correlations with the 
Binet ratings were calculated: first, the correlation between the 
Binet "mental age" and the Primer Test score for the 64 institu- 
tional feeble-minded cases; second, a similar correlation for 148 
children in the primary grades of Council Bluffs, Iowa; and third, 
a correlation for 57 unselected six-year-old children in the first 
grade at Washington, Indiana. (3) The writer chose this last 
group for a more detailed analysis by the method of partial 
correlation. The separate tests were intercorrelated, each test 
was correlated with the Binet ratings, and the partial coefiBidents 
and regression equation were calculated. 

3. Results. — The results of the first method are indicated in 
Table I which gives the distribution of scores on the Primer Scale 
of 120 unselected six-year-old children, for whom the writer had 
Binet ratings. The cases have been divided into five groups on 
the basis of the Binet I. Q's. Group I (the first column) includes 
the scores of those children with an I. Q. of 125 or above; Group II 
contains those children who obtain an I. Q. of 110-124; Group III 
those with an I. Q. from 90-109; Group IV those from 76-89; and 
Group V those with an I. Q. below 76. The five groups might be 
termed, very superior, superior, average, inferior, very inferior. 

There is some over lapping from one group to another, but 
the only distribution for which the amoimt of over lapping is sur- 
prising is that of the "average" group (Group III) whose distribu- 

'The writer wishes to express her obligations to the school superintendents of 

Washington, Bedford, and Bloomington, Indiana, and of Council Bluffs, Iowa; also, 
to Dr. F. Kuhlmann, Psychologist of the School for the Feebleminded at Faribault, 
Minnesota for the materials here presented. 
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tion over laps that of every other group. * The two extreme 
groups (I and V) are quite distinct from each other— that is, the 
lowest score in Group I is above the highest score in Group V. 
With the exception of one case, Groups I and II combined (i.e., 
the really bright children according to the Binet Scale) show no 
over lapping of test scores with the Groups IV and V combined 
(i.e., with the really dull children). The horizontal lines in 
Table I show the location of the 75-percentile, the median and 
the 2S-percentile for the total distribution of these unselected chil- 
dren — ^i.e., the standard norms derived from the complete surveys 
made. As will be seen, the children in Group I make no scores 
below the 7S-percentile for their age, while the children in Group 
V, with one exception, make no scores above the 2S-percentile. 
The lowest group is the most compact of the five. There is, 
in general, not as much over lapping of one group upon the other 
at the lower end of the distribution as at the upper end. This is 
imderstandable, as the brilliant children might not give their best 
performance and would thus make a lower score than they really 
should; while, on the other hand, it is not to be expected that 
adventitious circumstances would cause a dull child to be rated 
too high to the same degree. On the whole, the Primer Scale 
seems to have marked off degrees of ability as well as could be 
expected of a group test given to such young children. In this 
connection, it might be emphasized that some six-year-old children 
who make a low score on a group test receive a higher rating on 
the Binet examination because of the very different testing environ- 
ment. This aids in explaining the dropping down of scores in 
the first three groups into the distributions of the lower groups. 
Some of the cMldren making these scores lack, not intelligence, 
but independence. When asked to perform certain tasks in a 
group, they do not have the initiative to do their best; whereas 
they show a Binet rating more nearly commensurate with their 
true intelligence, because the examiner can constantly recall 
their attention and their efforts to the task in hand. The writer 
feels that the relationship shown in Table I is probably as high 
as can be expected between a group test and an individual test,' 
especially with such young children. 

• Lowell, Frances. "A group intelligence scale for primary grades," Journal of 
Applied Psychology, 3:215-48, September, 1919. The scale described in this article 
is a group form of the younger years of the Binet; 3ret the correlation between group 
score ana the rating on the Binet Scale when given to the same children individually 
is only +0.75. 
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TABLE L THE DISTRIBUTION OF SCORES MADE BY 1 20 SDC-YEAR-OLD 

CHILDREN ON THE PRIMER SCALE, GR0X7PED ACCORDING 

TO I. 0. ON THE STANPORD-BINET SCALE 
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The second method of studying the validity of the Primer 
Scale involved the calculation of the Pearson coefficient of correla- 
tion between scores derived from it and scores obtained by using 
the Binet Scale. The crude coefficients of correlation for each 
of the three groups of children are as follows: 

64 children from a feeble-minded school +0.75 

148 children in primary grades +0.66 

57 unselected children 6 years of age +0.62 

In all cases, the correlation is between group test scores and 
^'mental ages" on the Binet examination.^ The correlations are, 
the writer feels, as high as can be expected from the very different 
nature of the testing conditions for the two types of tests (group 
and individual). 

The scores of the 57 unselected six-year-old children were 
subjected to further analysis by means of partial correlation. 
The crude coefficients of the scores of each of die four tests which 
make up the Primer Scale with each other and with the Binet 
ratings are given in Table 11. 

TABLE n. CRUDE COEFFICIENTS OF CORRELATION BETWEEN 
TESTS OF THE PRIMER SCALE AND THE BINET SCALE, 

TAKEN PAIR BY PAIR 



LEGEND 



Tests 


1 


2 


3 


4 


1 










2 


0.59 








3 


0.48 


0.46 






4 


0.57 


0.55 


0.33 




5 


0.53 


0.45 


0.42 


0.47 



»» 



II 



II 



II 



II 



II 



1-Test 1, Primer Scale 
2 -Test 2, 
3=Test3, 
4=Test4, 
5 a Binet Scale 



This table should be read: the correlation between Tests 1 and 2 of the Primer 
Scale was found to be 0.59; between Tests 1 and 3, 0.48; etc. 

It will be noticed that the coefficients of correlation between 
the tests of the Primer Scale are rather high, except between the 
third and fourth. Because of this difference in the relationship 

^ The I. Q., which is frequently used for such correlations, is a percent statement. 
No similar statement was readily possible with the Primer Scale. Therefore, it was 
necessary to use taUd scores on both scales. Even in correlating the scores of children 
of the same age, the error introduced in using I. Q. is considerable, as the basis for 
calculating the I. Q. may range (in the case above) from 6 years and months to 6 
3rears and 11 months — or nearly a whole year. 
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between the tests, it is espedaUy desirable to find the partial 
correlations of each test with the Binet Scale^ to determine just 
what the independent value of each test might be. The resulting 
partial coefficients of correlation are as follows: 

r,..«»4«0.2436 
r»«.M»0.0951 
f»s»t«»0.1834 
f •4. >*a— 0.2006 

These partial coefficients should be read: the correlation of 5 
(Binet rating) with 1 (Test 1), the other tiiree tests being constant, 
is 0.2436; of Binet rating and 2 (Test 2), the other three tests 
being constant, is 0.0951. 

The partial coefficients are interesting in themselves aside 
from the part they play in calculating the regression equation.' 
The relative standing of the four tests in their relation to the 
Binet Scale, has not changed materially from that indicated by 
the original correlations (Table 11). The first test still has the 
highest correlation, and the order of decreasing coefficients is now 
the fourth, the third, and the second according to the partial 
correlations shown above. The second test seems to contribute 
almost nothing to the correlation of the whole scale with the Binet 
Scale, which is not already contributed by some other test. 
When the other tests are held constant, its correlation with the 
Binet Scale becomes practically zero (0.0951). Thus, the second 
test is, according to this criterion, the least valuable test of the 
scale* and the first test is the most valuable. 

m. The Reliability of the Primer Scale 
1. Materials. — ^The papers of all the children in the first and 
second grades, and of all the six- and seven-year-old children in 

* The regression equation of the Binet ratings on the four tests of the scale was 
found to be the following: 

1^ »0 . 5719^1+0 . 2142j;,+0 . 2844xs+0 . 538Qx<, 
where » Js the deviation of a pupil's score in Test 1 from the average, x% his deviation 
from the average in Test 2, etc s^ is the most probable deviation from the average 
Binet score. The scores of the original 57 papers used in the derivation of the equation 
were weighted in accordance with the above equation. This weighting raised the 
correlation from 0.62 to 0.65. 

' Since writing the above, the writer has tried a new method of scoring the second 
test, which takes account of possible chance successes, and has obtained a correlation 
of 0.52 instead of 0.45 as given in Table n. This difference in correlation mie^t 
make some difference in the relative standing of the second test as revealed by partial 
correlation. 
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the dty most recently tested were chosen as the material from 
which to estimate the reliability of the scale. 

2. Methods. — ^The degree of the reliability of the measures 
obtained by the scale and of its separate tests has been calculated 
in two wajrs. CoeflSicients of reliability have been found 
for each of the four groups just mentioned (grades i and n 
and ages six and seven). As there was only one form of the 
scale, the coefiBidents of reliability were calculated by dividing the 
scale into halves (using alternate items), correlating the scores of 
the half tests, and applying Brown's formula. ^^ This formula 
represents the extent to which the amalgamated results of two 
tests would correlate with a similar amalgamated series of two 
other applications of the same test. The formula is : 

2ri 

Both the total scale and each test have been treated in this way 
for the four age and grade groups. (2) The reliability has been 
calculated in terms of the probable error (P. E.), by the following 
method. Each pupil's score on one half of the scale was sub- 
tracted from his score on the other half. These differences were 
then averaged, giving an "average difference." 

The P. E. of a scale^^^XAv. Diff. 

^"2 

= 0.S978XAv. Diff.» 
This formula applies whether the two tests from which the 
average difference is foimd are two separate equivalent tests 
or two halves of the same test. If two separate forms of the 
same test had been used, the above formula (P. E.— 0.S978X 
Av. Diff.) would give the correct value, but in the case of the 
two halves of the same test, a further calculation must be made. 
The formula gives the P. E. of the half tests, but what is desired 
to obtain finally, is the P. E. of the whole test — not the P. E. 
of one of its halves. The P. E. of a test increases as the square 
root of its length; that is, in this case, the whole test is twice 
as long as its halves, and its P. E. consequently increases by v^. 
The P. E. of the whole test would, then, be equal to that of the 

^ Brown, William. Essentials of mental measurement. New York: G. P. Put- 
nam's Sons, 1911, p. 101. 

* Thomdike, E. L. An introduction to the theory of mental and social measure^ 
ments. New York: Teachers College, Columbia University, 1916, pp. 190-93. 
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half testy multiplied by the ^. The resulting formula for 
deriving the P. E. of a test from that of its halves becomes: 

P. E.=0.5978XAv. Diff.xv^l* 

3. ResuUs. — ^The coefficients of refiability for grades i and 
n and for ages six and seven are given in Table m. For grade i 
and age six, the first column represents the reliability of the scale, 
including all zero scores; the second column gives the reliability 



TABLE m. THE COEEFICIENTS OF REUABILITY BETWEEN 

THE TWO HALVES OF THE PRIMER SCALE FOR GRADES I AND U 
AND FOR AGES SIX AND SEVEN, AFTER APPLYING THE FORMULA: 

2ri 



ri = 



l+ri 



(In this formula ri is the coefficient of correlation obtained by 
correlating the two halves of the scale and rs is the co- 
efficient of reliability given in the table below.) 





GRADE I (142 cases) 


AGE SIX 


[90 CASES) 


Grade n 
(120 

Cases) 






Zero 

Scores 

Included 


Zero 

Scores 

Omitted 


Zero 

Scores 

Included 


Zero 

Scores 

Omitted 


Age Seven 

(103 

Cases) 




i 


2 


3 


4 


5 


# 


Total score 

Test I 


0% 
0.94* 
0.92 
0.89 
0.82 

• 


0.95 
0.90 
0.81 
0.81 
0.78 


0.95 
0.92 
0.88 
0.88 
0.84 


0.94 
0.89 
0.81 
0.81 
0.79 


0.89 
0.89 
0.67 
0.93 
0.54 


0.92 
0.84 


Testn 


0.68 


Testm 


0.93 


Test IV 


0.75 







omitting the zero scores. Neither method is satisfactory. If 
the test were to be given again, some but probably not all, of 
those children making zero scores would make a higher score. 
Since some of them would, the first column of coefficients, includ- 
ing all the zero scores, is too high: but, since not all of them 
would, the second column of coefficients, omitting all zero scores, 
is too low. Thus the true coefficient probably lies somewhere 
between the two. 

The coefficients of reliability are uniformly high for the whole 
scale and for the first and third tests, but vary considerably for 

* The writer is indebted to Dr. Walter S. Monroe for this method of determining 
the P. £. of a scale from the P. E. of its halves; as well as for many other hdpfitl sugges- 
tions and criticisms in the course of the statistical analysis. 
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the second and fourth tests in the different groups. The reliabil- 
ity, as measured by the correlation of one half of a scale to the 
other, is in part a measure of the consistency of the performance 
of the pupils, and in part a measure of the consistency of the 
test from item to item. It is the judgment of the writer that the 
reliability coefficient is mainly an index of the latter factor. If 
the halves of a test correlate highly, it is evident that the items 
composing the two halves demand the same, or approximately the 
same kind of mental effort. For Tests I and III this consistency 
is high; these tests are both "form" tests, they demand no informa- 
tion of any kind, and it apparently makes little difference which 
set of items is used. Tests II and IV call for information of a 
practical sort; the two halves of these tests correlate rather 
poorly — sometimes very poorly. Evidently, practical informa- 
tion is not at all the imitary thing that form discriminal^ion is; 
and the kind of information demanded by one item is different 
from that demanded by another. If still another form of the test 
were to be used, it is probable that these two tests would still 
correlate poorly, since these new items would involve still different 
informational elements. 

The P. E. of the scale was derived in the manner explained 
above. The P. E. of grade i (142 cases) was 2.39 "points," 
or units; that of age six (90 cases) was 2.20 "points," or units 
on the scale. Since the difference between the median of one 
age and the median of the next age is, on the average, twelve 
"points," or units, a P. E. of 2.39 points would equal 2.39 months, 
and a P. E. of 2.20 points would equal 2.20 months. Again, 
since there are about twelve points from one age to the next, 
a statement, for example, that a given child scores at the median 
for the age above his own, does not seem to be invalidated by the 
unreliability of the scale, since the differences between the suc- 
cessive medians are well beyond the P. E. of the scores. 

The P. E. of the Stanford-Binet Scale has been estimated by 
Otis to be about three and a half months.^® The P. E. of the 
Primer Scale is even less. If the same reliability can be obtained 
with a group scale as with an individual scale, the group scale can, 

^^ OtiS) A. S. "An absolute point scale for the group measurement of intelligence/' 
Journal of Educational Psychology, 9:341, June, 1918. 
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to some extent, take the place of the individiial scale, at least 
for the preliminary sorting of pupils. 

On the whole, the scale seems very reliable — unnsoaUy so when 
the ages of the children are considered. Considerable confidence 
may, therefore, be placed in the accuracy of the scores obtained. 

IV. Summary 

1. The writer presents data to show the reliability and the 
validity of the Primer Scale. 

2. The validity is shown (1) by the distribution of scores 
made on the Primer Scale by chfldren who have been classified 
according to I. Q. on the Binet examination; (2) by the correla- 
tions for various groups of chfldren between the group scale and 
the Binet ratings; and (3) by partial coefficients of correlation. 

3. The reliability is shown by (1) the coefficients of reliability 
for different ages and grades and (2) by the P. E. of the whole 
scale, as derived from the P. E. of the half scale. 

4. It is concluded that the Primer Scale is reasonably valid 
and reliable. 



THE APPLICATION TO TABLES OF DISTRIBUTION OF A 

SHORTER METHOD FOR COMPUTING 

COEFFICIENTS OF CORRELATION 

Leonard P. Ayres 

Russell Sage Foundation 

In the March number of the Journal of Educational 
Research there appeared an article by the writer on a shorter 
method for computing the coefficient of correlation. The method 
described avoids the necessity for finding the deviations of the 
separate measures from their averages and so eliminates the 
necessity for watching for imlike signs and making the series of 
corrections to allow for differences between the guessed averages 
and the true averages of the two series. The present article 
explains the application of the method to tables of distribution. 

The new method is based on the principle that in any series 
of numbers the sum of the squares of the deviations from the 
average is equal to the sum of the squares of the numbers in the 
series, minus the product of the total of the series and its average. 
The formula for this method is as follows: 

Sum of products of subject and relative items 

minus 
av. of subject items X tot of relative items 



V 



Sum of squares of sub. items Sum of squares of rel. items 

minus yC minus 

av. X total of these items av. X total of these items 



In using this method the multiplications are made first and the 
corrections are made separately. For two simple series of paired 
measures the operations may be illustrated as follows: 

Sub, Rel. Sub,* Rel.* Sub. X Rel, 





2 


3 


4 


9 


6 




3 


2 


9 


4 


6 




4 


4 


16 


16 


16 




7 


.4 


49 


16 


28 




9 


7 


81 


49 


63 


Tot 


25 


20 


159 


94 


119 


Av. 


5 


4 
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5X30-100 

SXIS-115 

4X20- 80 
119-100-19 
159-125-34 

94- 80-14 

19 ^ 19_ 19 _ 

*^34>a4 v'476 21.82 

The procedure is similar when the method is applied to a dis- 
tribution table. To illustrate it the case may be taken of a sup- 
posititious age and grade table for the elementary grades of a 
school system in which one hundred children enter the &rst grade 
each year at the age of six, are promoted by annual promotions of 
80 percent so that eight in each ten go forward and two repeat, 
and none drop out of school during the elementary years. The 
problem is to compute the coefficient of correlation between the 
ages and the grades of the children. The work, is as shown in 
the accompanying computations. The letters "S" and "R" 
stand for "subject" and "relative." 



s 

Grades 


B 


-Ages 








T 




6 


7 


8 


9 


10 


11 


12 


13 


ST SST 




100 


20 
80 


4 

32 


1 
9 


2 








1Z5 
123 


125 125 
246 491 








64 


31 


15 


5 






124 


372 1,116 










51 


4; 


2( 


1 


3 


ii; 


492 1,968 












41 


4: 


1* 


11 


11* 


590 2,950 














32 


41 
26 


27 
39 


101 
65 


606 3,636 
455 3,185 


















21 


21 


168 1,344 


T 


100 


100 


too 


100 


100 


too 


100 


100 


800 


3,054 14,816 






















Av. of sub. items 


RT 


600 


700 


800 


900 


1,000 


1,100 


1,200 


1.300 


7.600 


^.3.S,„*v. 


RRT 


3,6a 


4,90C 


&,40C 


S,10C 


10,000 


I2,10C 


U,40( 


16,90C 


76,400 




£Sf 


lOO 


tsc 


26C 


JK 


422 


503 


ss; 


fi« 






R{ISf) 


600 


1^60 


2,080 


3,060 


4,220 


5,533 


6,996 


8.658 


32,407 
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3,054X9.5-29,013 

3,054X3.818-11,660 

7,600X9.5-72,200 

32,407-29,013-3,394 
14,816-11,660-3,156 
76,400-72,200-4,200 

3,394 3,394 3,394 ^ 

'0.932 



1/3,156X4,200 1/13,255,200 3,641 

In the illustrative example the columns headed ^^ST" and 
''SST" give the items of the subject series and the squares of 
these items. They are found by the simple process of multiplying 
the numbers in the total column by those in the column headed 
''S" at the extreme left of the table and then multiplying these 
new totals by the ''S" numbers once more. A similar process 
gives the "RT" and "RRT" rows at the bottom of the table. 

The next step is to find the products of the paired values. 
This is done in the two last rows at the bottom of the table. The 
first is headed ^^ZSf" and gives for each column the sum of the 
products of the numbers in the ^'S'' column and their correspond- 
ing frequencies in the body of the table. Thus the sum of the 
products for the second column is 180 and consists of 1 X 20 
plus 2 X 80. 

After all these sums of products are found and entered in the 
row headed "2Sf," they are multiplied by the "R" numbers at 
the heads of the columns and the results entered in the lowest 
row headed R(2Sf). 

The averages are found by dividing the total of the subject 
items (3,054) by the number of cases (800) which gives 3.818. 
Similarly the sum of the relative items (7,600) is divided by 800 
to give the other average of 9.5. 

The next step is to find the three "total X average" products 
and to make the three corrections which appear after the table. 
The first product is that of the total of one series (3,054) and the 
average of the other (9.5), or 29,013. This is subtracted from the 
sum of the products of the paired values (32,407) giving the 
remainder 3,394. This equals the sum of the x times y products 
as found in the conventional formula: 

Zxy 
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Similarly the sum of the squares of the items of the subject series 
(14,816) is corrected by subtracting from it the total of the series 
times its average. The corresponding operation is done for the 
relative series. The final operations follow the formula given 
at the beginning of the article and are the same as those of the 
conventional procedure. 

The work is greatly facilitated by the use of an adding machine. 
The writer did all the work of the example given in twenty minutes 
after the age-grade table had been written down and checked it 
by repeating all the operations in fifteen minutes. This was 
done with the aid of a con^tometer — a, small, non-listing, 
adding machine which can also be used for multiplying. 

On work such as that given in this article the new method is 
found to be in practice much faster than the old one and errors 
in computation are very much less likely to be made. 

Erratum 

In Dr. Ayres' first article in the March nxmiber of the Journal 
or Educational Reseasch at page 220, middle of page, read: 
"Second correction -214- (6x30) -214- 180-34." 




THE ACHIEVEMENTS OF THE SCHOOL YEAR 

As the school year draws to a dose, do the plans of superin* 
tendents and teachers involve taking an inventory of the achieve- 
ments of the year? The merchant, the manufacturer, or the 
banker (and we are beginning to include the farmer) who does not 
at least once a year take an inventory of his business is generally 
considered to be headed toward certain failure. If when dealing 
with such tangible things as clothing, drygoods, machinery, auto- 
mobiles, corn, cattle, and hogs, it is necessary to measure accurate- 
ly the results of one's activities during the year, how much more 
is it necessary to render an accounting when one is dealing with the 
less tangible achievements of the school room. 

In the records of the school census, attendance, enrollment, 
withdrawals, and promotion the superintendent has at hand much 
of the crude data which an inventory of his business requires. 
Many superintendents have given, at times during the year, one 
or more standardized tests. The results from these furnish addi- 
tional crude data. However, in order to secure a satisfactory 
inventory, there should be an appraisal of the achievements of the 
pupils during the school year. The way to do this is to plan a 
comprehensive testing program for use toward the close of the 
school year. With the large array of standardized tests now 
available, the superintendent can secure the instruments needed 
for measuring many of the important achievements accomplished 
during the year. 

The labor involved in the preparation of an inventory of the 
year's work will perhaps appall many schoolmen. Some will 
doubtless claim that they have been successful in the past without 
rendering an account of the year's work. In reply to these it is 
only necessary to say that there was a time when many merchants 
were successful who never made an inventory of their business. 
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child must force himself upon the attention of someone who has 
backbone enough to break away from tradition. Classroom 
procedure is not organized so as to favor a child's forcing himself 
into recognition. Moreover, in many places even if superior 
ability is perfectly evident, nothing short of a miracle will cause 
the traditional system to break its regularity of habit. 

The latest development in mental testing is the group test. 
It can be given to hundreds of children in a single day. It affords 
impersonal data from which to estimate a child's capacity, and it 
thus removes the decision from the field where the personal 
feelings of teachers or of fond parents play a part. Experience 
proves that these group tests, in spite of the ease with which they 
may be administered, have a high degree of reliability. The 
results can be used for "spotting" individuals; and wherever 
there are serious differences between test results and other data, 
the child may be given further study or additional tests. These 
group tests ought to come into immediate and extensive use for the 
discovery of superior mental capacity in all classes from grade 
three up. Indeed, some group tests promise to be fairly reliable 
even below the third grade. Individual mental tests should be 
used on all school children who are too young to be tested by 
means of a group test. 

No superintendent or principal should be satisfied with any- 
thing less than a complete and systematic search of his school for 
superior ability. Having found such ability, he should devise 
ways and means to handle the administrative problems of educa- 
tion so that this ability may be put to work. This is not altogether 
easy. It means that more thinking and more effort must be put 
into both administration and teaching. The problem can be 
solved, and it is being solved in many places. Various plans are 
being used but none of them is as important as the clear realiza- 
tion that superior mental capacity should be used and trained 
instead of being allowed to waste away in the formation of habits 
of idleness and mischief. 

With such a realization, intelligence properly applied will 
meet the problem. Whether we like the work or not, it must be 
done. Let us face the task squarely. With due apology to 
advertising, we may say "do it now, for eventually you must." 

VisGiL E. Dickson 
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Trabue Language Scales, B, C, D, and £, grades four to twelve 
V. Language 

Denver Composition Test, grades four to twelve 

This volume stands out as distinctive in the series of volimies which 
make up the report of the survey of the Gary public schools. In the first 
place, it contains 532 pages besides the introduction and author's preface. 
The next largest, which is the summary volume, has only 265 pages. Second, 
it comes from the press several months after the others have been in the 
hands of readers and more than three years after the giving of the tests in 
Gary was completed. Third, the volume is a combination of the report of 
the survey and a treatise on the theory of educational measurements. 

Besides a chapter given to each of the school subjects for which tests 
were given there are four other chapters: Chapter 1, "General Statement," 
in which is included a brief discussion of the status and limitations of edu- 
cational measurements; Chapter 2, "Tests and Testing Conditions;" Chapter 
8, "Factors AflFecting Performance;" Chapter 9, "Conclusions." There is 
an effort to make the report as readable as possible. The presentation for 
each school subject is divided into three parts. First, there is a concise 
non-technical discussion of the significant aspects of the data secured. 
Second, there is a discussion of "all that is involved in the testing process." 
Third, in the appendices of the volume there is reproduced a number of the 
tabulations and a quantity of other data in which students of education will 
be interested. This organization materially facilitates the reading of the 
report for one who is not interested in critical discussions of the tests. One 
is disappointed, however, in not finding a concise summary statement of the 
findings for each subject. A partial exception to this statement should be 
made in the case of handwriting. A judicious use of paragraph headings 
would materially increase the clarity of the report. 

The volume must be judged both as a report of the Gary survey and 
as a treatise on educational measurements. The conception of the survey 
is shown to have been comprehensive and the precautions exercised in its 
execution may well be taken as a model for future surveys. For example, 
several tests were used in each school subject. This is good procedure, 
because no single test can possibly have the same reliability that a battery 
of several tests has. Furthermore, no one test can cover the entire field of 
a school subject. Again, the scoring was done in duplicate by pupils and 
checked by examiners. This also contributes to the reliability of the pub- 
lished results. Among a number of other instances of the precautions taken, 
one may mention the fact that the judges who rated the compositions were 
carefully trained to their work before they began scoring. 

In general the interpretation of the scores id made with imusual care 
and fairness. In English composition, for example, pupils wrote on the 
same subject and imder the same conditions as obtained in the surveys of 
Denver and Grand Rapids. The compositions from these latter cities 
were, however, measured by the Willing Scale. In order to secure compara- 
tive data by which to interpret the Gary results it was obviously necessary 
to have the Gary papers rated on the same scale. The added precaution 
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WIS taken of having them (those of the eighth g;rade) rated by the same 
person — namdy Mr. Willing — who rated the papers at Denver and at Grand 
Rapids. Many other instances mi^t be given of the mrasnal care and fair- 
ness with which interpretations were made. Indeed, the author shows a 
diq>osition to set up and dispose of as many possible objections as he can. 
He seems to a,ssiimc — with some truth we admit — that his oondusions will 
be assailed. His state of mind in this matt^ mi^t be described as "ner- 
vous." 

The author states as a general conclusion, "that the product of the 
class room teaching of the fundamentals is, at Gary, poor in quality and 
inadequate in amount; it approximates in character the i»oduct of the poorer 
conventional schools, and reveals in no particular the sli^test indication 
that it has been affected either favorably or unfavorably by the enriched 
curriculum or other ^)ecial features of the Gary schools. .... The entire 
investigation reveals many and consistent evidences of careless work, imper- 
fectly developed habits and marked lack of achievement." (p. 384) A care- 
ful study of the results of the tests reveals many instanres which confirm the 
above statement. In many cases the Gary scores are below comparative 
data from conventional schools. In some cases, however, the Gary scores 
compare favorably with the "available standards" and in a few cases com- 
parative data are not used which would result in a more favorable though 
not necessarily reversed conclusion in respect to Gary. 

For example, in interpreting the handwriting scores for quality compara- 
tive scores from Iowa, Qeveland, St. Louis, Grand Rapids, and Kansas City 
and the standards proposed by Freeman and Starch are used. It is entirely 
possible that the average performances of the pupils in conventional schools 
are too high for satisfactory standards. No reiference is made to the studies 
by Ashbaugh^ and Koos* in which they indicate that possibly the standards 
for quality should be lower than Freeman and some other investigators have 
indicated. Ashbaugh shows that the New York Civil Service Conmiission 
accepts 40 and 50 for "passing" in writing; and Koos proposes an ultimate 
standard of 60, even fmding" considerable justification" for 50. The eighth- 
grade median for Gary was 43. 

The conclusion is reached that "handwriting instruction at Gary is 
producing very small effect upon the product."^ (p. 46) Thb gives one the 
impression that the handwriting is entirely unsatisfactory. While it is true 
that quality at Gary is below even the lowest proposed standard, it is equally 
true that rate is notably above the rates used as comparative data. Rate 
of writing is important and credit should be given for this phase of the 
product of instruction in handwriting. Indeed, the author does so in other 
connections. It may be noted in passing that this is not the only instance 
in the report of inconsistency of statement. 

> Aihhangh, E. J. Hamdwriting of Icwa school chUdrm. (Bulletin of State Unhrenity of Iowa, 
March, 1916.) 

* Kooa, L. v. *The detcrminatioo of ctltiniate standardi of quality in handwiitinf for the public 
ichoob," BemeHtaty School Jomrual, 18:423, February, 1918. 
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Another example may be dted from the chapter on English composition. 
In addition to judging compositions by means of the Hillegas Scale, a study 
was made of the vocabulary used by the eighth-grade children at Gary. 
Comparison is made with the vocabularies reported by Jones and the con- 
clusion is reached that ''a careful study of the vocabulary fails to show any 
clear effect of special training at Gary." In the discussion there is no recog- 
nition of the possible effect of the foreign population of Gary upon the vocabu- 
lary of the children. This factor may have been taken into consideration 
but there is no direct evidence of it. Neither does he consider the possible 
effect of the fact that each child at Gary wrote but one composition — and 
that on ''an exciting experience" — ^while the children in Jones' study wrote 
on the average 105 compositions each and were judged to have exhausted 
their vocabularies. 

A third example of conclusions at variance with the sweeping general 
statement quoted above may be taken from the chapter on reading. The 
Kansas Silent Reading Tests yielded median scores at Gary which approxi- 
mate the standard for conventional schools from the sixth grade to the eighth 
grade inclusive and which are rather notably above standard for grades 
nine, ten, and eleven. It is only in grades three and four that the Gary 
scores are materially below standard. It is true that these facts are stated by 
the author in their appropriate places. The point, however, is that they 
are not reflected in his general conclusions. 

In the summary volume the following paragraph appears. "The 
impressions gained through inspection and the results of the tests are not 
entirely consistent. For example, silent reading makes a distinctly better 
showing in the tests than one would have expected on the basis of class room 
observation. Spelling makes a poor showing on the list test and a very good 
showing on the composition test. It is not possible to reconcile these diver- 
gencies without adducing considerations as to which different opinions could 
fairly be entertained. Without, however, seeking to ignore the conflict of 
evidence, the authors still feel that the quality of class room instruction at 
Gary falls short of what is necessary." (p. 102) 

After studying the survey report on ''Measurement of Classroom Pro- 
ducts" and finding the interpretation of results open to such criticisms as 
indicated above, one cannot help feeling that at times the author has allowed 
his interpretations to be colored by what the writers of the summary volume 
suggest to have been the prevailing opinion of the survey staff. Even if 
such instances are not nimierous in the report, it is unfortimate that they 
exist at all, because the objective nature of standardized tests has probably 
been the most convincing argument in favor of their use. If the measure- 
ment is objective but the interpretation becomes subjective, this argument 
loses its force. 

As a treatise on the theory of educational measurements, the volume 
is a notable contribution. It contains a discussion of the nature of the 
abilities and detailed descriptions and analyses of certain of the tests used. 
Mr. Courtis gives for the first time an accoimt of the construction of the 
Courtis Standard Research Tests in Arithmetic, Series B. A more complete 
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account is ghren of tlie validity and idiability of most of the tests used than 
lias heretof OTe been poUished. 

In Cha|iter Vm tlie author considers the factors upon which perfor- 
mance dq)ends. This constitutes an important analjrsis, and throws an 
mieq>ected ligjit on the mraning which may be attadied to the Gary scores 
in d iff ere n t tests. The basic factor iqx>n which performance depends is 
heredity or "capacity/' The maturity of the pu|Ml is a second important 
factor. Maturity together with general training (a third factor) b shown 
to be more potent in the Gary schocds than ^)edalized training (a fourth 
factor) in the development of the following abilities: rate of a^3dng figures, 
oral reading, writing of multiplication combinations, handwriting (aH tests), 
addition in Series B, and rate of silent reading as revealed by the Kansas 
Slent Reading Test. On the other hand, q)eciaUzed training is more potent 
in engendering accuracy of performance— e.g., in silent reading, long division, 
addition and subtraction of simple fractions. This distinction is fundamen- 
tal in judging the efficiency of ^)ecialized instruction on the basis of scores 
yidded by standardized tests — and it is a distinction which Mr. Courtis has 
more ably presented than any other survey writa*. 

Students interested in the theory of educational measurements will find 
the report a source of much valuaUe information. The various "critical 
discussions" of the tests, however, which are announced to contain "all that 
is involved in the testing process," fall disai^wintin^y short of the realisation 
of this ambitious announcement. For examine, in the critical discussion of 
q)elling, the author points out that the ability to spell is "^>ecific" (although 
it may contain a general factor), and that from a child's ability to ^)en one 
word no reliable inference can be made concerning his ability to sgifSi any 
other word. However, a pupil's spdling of a number of words can be used 
as a basis for infering his ability to ^)en other words belonging to the same 
difficulty group. The reliability of the inference is greater when random 
samples are used and increases with the number of words. Unfortunately, 
the discussion does not deal with the relation between the reliability of the in- 
ference and the number of words used, except to say, "it seems to the writer 
probable that the conclusions would not be changed were the number of 
test words to be largely increased." 

Neither does the author investigate the relation between the reliability 
of a test and the difficulty of the words used, or the rdation between the 
rdiability of a test and the method of giving the test words. These omissions 
occur in ^ite of the author's statement that "the preceding discussions 
have had for their purpose the full statement in regard to the validity of 
the performance of an individual in a single test as a measure of his ability 
in spelling." 

The discussions for the other subjects have similar limitations. At the 
present stage of the development of measuring instruments and the analysis 
of the measuring process, it is not to be expected that the "critical discus- 
sions" would be complete. In fact, they contain much more than one might 
expect, since they are somewhat incidental to a survey report. The pro- 
priety of attempting to include in such a report a discussion of "all that is 
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involved in the testing process" will doubtless be questioned by many readers. 
One finds many pages that appear to contribute very little to a report of the 
"measurement of class room products," although undoubtedly they will be 
conunended by those who are interested in the theory of educational measure- 
ments and would very properly find place in a treatment of that topic 
The inclusion of these topics undoubtedly delayed the preparation of the 
report, and in this way lessened the value of the voltmie as a report of the 
siuirey. 

In the dual character of the report, there is evidence that as yet we have 
not found a satisfactory procedure for reporting the use of educational 
tests in a school survey. If the author gives no more than the results and 
his interpretation of them, he may be accused of misinterpretation and even 
misrepresentation by some of those who do not understand the process of 
measurement and the limitations of the particular tests used. On the 
other hand, if, as in this case, the author enters into a critical discussion of 
the tests and the theory of measurement, the report may lack unity and will 
certainly become voluminous. It may fail to be effective in making clear 
the actual conditions which were found to exist. Presumably Mr. Courtis 
was interested in the opportunities that the survey afforded for research. 
At any rate, it is certain that as a contribution to the literature of educa- 
tional research his book is a more notable contribution than it is as a report 
of the measurement of classroom products at Gary. 

W. S. M. 

BucKNER, Chester A. Educational diagnosis of individual pupils (Teachers 
College, Contributions to Education, No. 98). New York: Teachers' 
College, Coltmibia University, 1919. 93 pp. 

Fretwell, Elbert K. A study in educational prognosis (Teachers College, 
Contributions to Education, No. 99). New York: Teachers' College, 
Columbia University, 1919. 55 pp. 

These are companion volumes in the sense that the investigations which 
they report were carried out upon the basis of the same tests of the same boys. 

Dr. Buckner investigates the methods by which scores in one test may 
be legitimately compared with scores in another, the amount and distribution 
of individual variability, the existence of erratic scores, the causes of extreme- 
ly variant scores, and the relation between ability and variation. To express 
these scores in terms of the standard deviation or the quartile deviation per- 
mits comparison between them, and at the same time retains the refinement 
of the original scores. 

As usual it was foimd that pupils varied widely in a given test, extreme 
scores being more numerous below the median than above it. It was also 
found that a given pupil differed markedly in his scores on different tests, 
the scores having first been made comparable. It appears that the more 
capable pupils — if we may draw practical conclusions from theoretical dis- 
cussions — not only do better work but that they do it more consistently. 

It is pointed out, moreover, that while some of the variability and some 
of the extreme scores are caused by distractions and other chance occurrences, 
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As to "Caoses of Extreme VaraMrry." the foAowins are considered: 
(a) the nature of the tests; '!>> their admmktratioo; (c) acadental occur- 
; (d> statistical trcatznent of the resaks; and (e) the abflity of the 
in diff er en t traits. 

Two important practical oooEsideratioas as to the natore of tests are dis- 
tinguished. First, the range of a test most be somewha t greater than the 
range of abilitT in the group tested. Seoood, the intcrrab between possible 
scores on the test most be smalL 

We shall not take up each of these fire causes. XatnraOy it is the 
ability of the popil wiuch most affects extreme variability. One of the 
practical condusions reached in this connection is that extreme scores are 
fittle, if any, more onn^able than those near the mrdian Tliis appears to 
be particnlariy applicable to low scores de^xte the fact that accidental 
occurences tend to depress rather than raise results. The evidence cm this 
is the fact that ability and variabifity bear a direct relation to each other. 

Dr. Fretwell takes up the investigation at the point where Dr. Buckncr 
leaves it. He asks: ^Can afadfmif success be predicted? If so, how?" The 
conclusion is reached that academic success can be predicted. When all 
temporary illnesses, ranging from bad colds throu^ contagious disrasfs to a 
month in the bo^tal, all fortunes or misfortunes in the home life, barring 
withdrawal from school, all the change in physical conditions and var3ang 
interests among bo3rs of deven to thirteen — when all these and a score <^ 
others that might be enumerated are considered — the use of these tests in one 
and one quarter hours' testing at the beginning of the year would have agreed 
with the classification of the teacher after teaching the pupils one year in 
90 percent of all the cases. 

As to the best basb of prediction, three others besides the tests are con- 
sidered — school marks from the beginning of each pupil's school career, age, 
and the combined estimates of departmental teachers. The results of these 
comparisons lead the author to say: "In this study, academic success in the 
first year of junior high school was more successfuUy predicted by a group of 
standardized tests than by all previous school marks or age or teachers' 
estimates." 

Some tests prove more valuable for prediction than others. The follow- 
ing is the order of importance as the author found it: reading (Thomdike's 
Understandingof Sentences), visual vocabulary, opposites, spelling, comple- 
tion tests, arithmetic tests (Woody), easy directions, mixed relations, and 
composition. 

B. R. D» 
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Wilson, Guy Mitchell. A survey of the social and business usage of ariih- 
metic. (Teachers College. Contributions to Education, No. 100). 
New York: Teachers College, Columbia University, 1919. 62pp. 

The content of school subjects is largely determined by tradition. This 
simply means that the content as originally determined tends to be retained. 
Changes are made from time to time but in general they lag far behind social 
and school needs. Recently the attention of educators has been directed to 
curriculum making, and many investigations have been undertaken to deter- 
mine what should constitute the curriculum in a nimiber of school subjects. 

Tradition has influenced to a very large degree the curriculum of arithme- 
tic as it is now taught. Since the work of Rice in 1893 and McMurry's 
proposals enunciated in 1904, a nimiber of investigators have attacked the 
problem of determining what the course of study in arithmetic should be. 
Professor Wilson has employed a procedure which b different from that used 
by preceding investigators. 

He states that the ''problem set for solution in this study is to determine 
the arithmetic actually used by adults in their social and business relations." 
Accordingly pupils in the sixth, seventh, and eighth grades in 23 cities, 
and in certain rural schools were requested to secure from their parents 
the arithmetical problems which the latter had solved during a period of two 
weeks. Reports were obtained from 4,068 persons and the total nimiber of 
problems after unsatisfactory reports were rejected was 14,583. The author 
demonstrates that the group of persons reporting is probably sufficiently 
representative of the population of the entire country with the exception of 
commimities which have specialized activities. 

The 14,583 problems were analyzed as to the topics involved and the 
magnitude of the numbers occurring in the four fundamental operations. 
For both integers and fractions, common and decimal, the author f oimd that 
six topics (namely, multiplication, addition, subtraction, division, fractions, 
and accounts) include slightly more than 90 percent of all the problems. 
The remaining 10 percent are divided among 37 additional topics. 

With reference to the magnitude of the nimibers, the author found that 
they rarely exceeded four places and that the majority of them did not extend 
beyond two places. He found only 50 different common fractions in all of 
the problems reported, and 40 of these occurred eight times or less. 

Although the title and the explicit statement of the author's problem 
indicate that the study was made to determine what arithmetic is actually 
used by adults in their social and business relations, it appears from a reading 
of the monograph that the author's real purpose was to determine in a general 
way what shoiUd constitute the curricidum in arithmetic in the elementary 
school. In making this application of his results, he announces two main 
assumptions: 

''(1) Aim of Arithmetic in the Grades. While not denying the cultural 
and disciplinary value of arithmetic — in common with any subject systema- 
tically studied and well taught — it is assumed that arithmetic in the grades 
is justified only on the basis of its utility in the common affairs of life. We 
learn the multiplication table not to sharpen the wits nor to comprehend a 
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(J) that the best way to prepare a chSd lor ^^igarxnc^ b to ose & aniicaliim 
bttied foidy Qpoa the ptofalems which adults ose. 

The aikhor docs not fom i dfr the school needs which a pupil may haire lor 
anthmetk in the study 6L yoyaphy , history, science^ mamnl tninins, and 
other school subjects. Until the agi i ml um s for these sob jects are changed 
ladically, pupils will haire need lor certain aspects of arithmetic. In the 
absence of a sdeatific analyib of their anthniftical reqimrment^ one shodkl 
not assome that they are fnrhidfd in the adult social and huroess usa^es.oi 
arithmetic. 

Doubtless many readers will be unable to agree with Prolessor Wibon 
in his assumption that no arithmetic should be tan^ in the dementaiy 
school beyond the ^essentials required by social utility^ and that "social util- 
ity can be determined only on the basis of the uses of arithmetic in adult 
actlrities/' Doubtless most readers will be willing to accept this as one of the 
important bases; but absolutely to reject other bases — as the author does — 
is to take a radical position. This is especially true since he implicitly makes 
other assumptions, as has been pointed out, which deserre consideration in 
the making of a course of study. 

To define the usable product of arithmetical instruction as ''figuring" is 
to Umit decidedly the significance of the subject. It is true that ''figuring" 
is the most tangible and con^cuous outcome; but other outcomes, although 
they are more subtle, are nevertheless important and should be definitely 
planned for in the making of a ctirriculum. Furthermore, it is not safe to 
build a curriculum on the assunq>tion that adults are now making all the use 
of arithmetic which they should make in their social and business activities. 
There seems to be con^derable unanimity of opinion that in many respects 
adults are now lacking in efficiency with re^)ect to quantitative matters. As 
ill i n s t ance of this we may dte the agitation for famfly budgets and farm 
accounting* 
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Professor Wilson's study will no doubt have a far-reaching effect upon 
school practice. It should, because it is by far the most valuable work which 
has been done on minimum essentials in the field of arithmetic. As a survey 
of the social and business usage of arithmetic the monograph is a notable 
contribution and will probably rank, as the author suggests, with that of 
Ayres and Jones in the field of spelling. To the writer it appears, however, 
that he has lost sight of certain important considerations in applying the 
results of his siurvey to the making of a curriculum for arithmetic, as is 
indicated in the implied assumptions given above. Some of his conclusions 
with respect to the curriculum will probably stand when a more conservative 
and anidytical interpretation is made of the data collected, but all of them 
should not be accepted until the effect of the implied assumptions and possi- 
bly of other factors is known. 

W. S. M. 




Standardized Tests tor the High School 
{CofUinued from March number page 242) 

C. Algebra (Continued) 
Stromquist's Preliminary Algebra Tests. This series includes tests upon 
the following operations: (1) addition; (2) subtraction; (3) multiplica- 
tion; (4) division; and (5) factoring. 
Publisher: University of Wyoming, Laramie, Wyoming. 

Thomdike's Algebra Test. This b a series of eight dkerdses arranged in 
order of increasing difficulty as determindd by the opinion of competent 
judges. 

Reference: Thorndike, £. L. "An experiment in grading problems in 
algebra," Mathematics Teacher, 6:123-34, March, 1914. 

D. Geometry 
Irwin's Tests in Mental Manipulations of Space Relations. The author feels 
that this ability b not confined to mathematics alone, but it b constantly 
in demand in other lines as sewing, general science, drawing, Englbh, 
etc. He has, therefore, worked out four tests (Tests A-D) which should 
"yield a rough measure of the ability of each pupil in a class to image 
space relations." 

Address: H. N. Irwin, Fairmount Junior High School, Cleveland, Ohio. 
V Reference: Irwin, H. N. "Preliminary attempt to devise a test of the 
ability of high school pupib in the mental manipulations of space 
relations," School Review, 26:600-6, 654-70, 759-72, October- 
December, 1918. 

The derivation o! the tests b described tad the tests are reproduced. 

Minnick's Geometry Tests. Thb series of tests b based on the assumption 
that demonstration of a geometrical theorem involves the following 
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pfOCi. 

FwUisker: J. BL Mmiiirk. UnhrersitT of Pamsyhrama, Philaddphia, 
Pe nnsyiva iiia, Also obtainable innn Bvreaa of Edncatioiial Re- 
search, Unive i sit y of IHmnK, Urbana, IBmnis 
' Reference: Mmnirk, J. BL ^A scale for m ea &uiin g pupils' ability to 
donoDstiate geometrical theorems,'* Sck^ RfwUm^ 27:101-9, 
February, 1919. 




Minnick, J. BL '^Certain abilities fnmlamental to the study of geom- 
etry," JomnuA of Edmcaiimtsl PsyckeUgy, 9:ft3-90, Fdimary, 1918. 

J. BL i4« imdesUgaHon of certaim abSsiies fmmdatmemtal to ike 
shtdy cf geometry. Philadelphia: University of Penns}dvania, 1918. 

latkMBOMnnpkDr. 




Starch's Geometry Test. 

Address: Daniel Starch, University of Wisconsin, Madiscm, Wisconsin 



Stockard and B^ Geometry Test. A test oi seventy qaestions which 
involve drawing figures, naming figures, indicating order of devdc^ment 
in demonstration, completing statements, stating the converse, defini- 
tions, regular polygons, parts of a demonstration, etc 
Stockard, L. V. and Bell, J. Carleton. '"A preliminary study of the 

measurement of abilities in geometry," Journal of Educational 

Psychology, 7 -.567-80, December, 1916. 

Derivatioo, prdiminaiir form it|>n>duced. Analysu of resalts. 

DC Mental Tests 

Army Tests. The mental tests which have been used extensively in the 
army were prepared by the Psychology Committee of the National 
Research CoundL Three systems of tests are now in use: 

1. Alpha. This is a group test designed for men who can read English. 
It requires only fifty minutes to give. The exercises are designed so they 
may be answered without writing, merely by underlining, crossing out, 
or checking. The papers may be scored by means of stencils, so that 
nothing is left to the personal judgment of those who do the scoring. I9>-'^ 

2. Beta. This is a group test for foreigners and illiterates. Success in 
Beta does not depend upon knowledge of the English language, as the 
instructions are given entirely by pantomime and demonstration. 

3. Individual Tests. Three forms of individual tests are used: Yerkes- 
Bridges Point Scale, the Stanford-Binet Scale, and the Performance 
Scale. 
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Address: Division of Psychology, Medical Department, War Depart- 
ment, Washington, D. C. 

References: Army menkU tests, methods, typical results, and practical 
application. Washington, D. C, November, 1918. 

Tins bulletin dcacrfbet the three tjrpeso! tests uaed in the tfmy. It sJso gives an espUnation of 
letter ratings and directions for the use <^ intelligence ratings. 

Madsen, I. N. and Sylvester, R. H. ''High school students' intelligence 
ratings according to the alpha army test," School and Society, 
10:407-10, October 4, 1919. 

Results of the Alpha test giren to the Jhigh-school studenU of Rocklord. Illinois, Madisoii, 
Wisconsin, and Sioux C^, Iowa. 

Van Wagenen, M. J. "Our schools as measured by the army tests," 
Educational Administration and Supervision, 5:163-76, April, 1919. 

Mr. Van Wagenen states: "The use of the Army Tests in certain elementary schools, Ugh 
schools, and universities for the purpose of gathering information for the use of psychologists in the 
army has, at the same time, revealed very dearly certain facts about the schools, the students 
tested, and possible values of mental tests in educational practice." The author describes Army 
Test £ and compares it with Alpha, form 6. Table II gives the weighted scores of elementary school 
pupils, high school freshmen, and college men and wtmien. 

Materials from the Army Tests under the title of "National Intelli- 
gence Tests" have been standardized by a committee of the National 
Research Coimdl. They are to be published this spring, 1920, by the 
World Book Company, Yonkers, New York. 

Honey's Sentence Vocabulary Scale. This scale has been devised with the 
Terman Stanford-Binet Vocabulary as a basis. The words of this well- 
known vocabulary are put in sentences, the last word of which is found 
among four words to the right. The pupils indicate the correct responses 
by underlining the word which completes the sentence. Thb scale has 
been found to be a fair measure of intelligence. Series 3B b for grades 
vn toxn. 
Publisher: Bureau of Educational Research, University of Illinois, 

Urbana, Illinois. 
Reference: First annual report of Bureau of Educational Research, 1918- 
1919. 

Otis* Group Intelligence Scale. This scale is composed of ten tests which 

measure various phases of mental ability. Two forms of the scale are 

available. They may be used in grades vi to xn. 

Publisher: World Book Company, Yonkers, New York. 

References: Otis, A. S. "An absolute point scale for the group measure- 
ment of intelligence," Journal of Educational Psychology, 9:239-61, 
333-48, May-June, 1918. 

Report of the Department of Research, being part of a report of the superin- 
tendent of schools of Oakland, California, 1917, p. 210. 

Theisen and Fleming's Classification Test. A group test based on the Army 
Test (Alpha) , has been successfully used for high-school purposes. Takes 
fifty minutes to give and may be scored at the rate of 15 papers per hour. 
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PMisker: Bureau of Publicatioiis, Teachers College, Columbia Univer- 
sity, New York City. 

Reference: An artide by Dr. Theisen entitled, "Group Intelligence 
Tests," will appear in an early number of the Journal of EducaUonal 
Research. 

Thnrstone's Psychological Examination for CoUege Freshmen and High 
School Seniors. 

Address: L. L. Thurstone, Carnegie Institute of Technology, Pittsburgh, 
Pennsylvania. 

X. Music 

Baldwin's PnbUc School Music Test. A preliminary test of the efficiency of 
public school music. It is aimed to measure the accomplishment of 
pupils. In this respect it is similar to the Courtis Standard Research Tests 
in Arithmetic 
Reference: Baldwin, Ralph. "Efficiency in school music teaching and 

practical test of the same," Music supervisors* national conference 

proceedings^ 1914, p. 43>50. 

On page 46 the tot b reproduced. 

Seashore's Musical Talent Chart. This chart is based upon the analysis of 
musical ability and offers a graphic means of representing the pupil's 
musical ability. The pupil's musical abilities are measured by his 
response to tones which are mechanically produced. The chart is 
simply a convenient device for recording the responses of the pupil. 
The records for testing a child are made by the Columbia Graphophone 
Company, Woolworth Buflding, New York. The Manual for Measures 
of Musical Talent, furnished free by the Educational Department of the 
Columbia Graphophone Company, contains directions, norms, and 
interpretations. 

References: Seashore, C. E. "The measurement of musical talent," 
Musical Quarterly, 1:129-48, January, 1915. 

A diacusaioa of the elements whkh make up musical taknt and the deriyation of the Mnsical 
Talent Chart, the chart itself, and its meaning and use. 

Seashore, C. E. "The r6le of a consulting supervisor in music," Eight- 
eenth Yearbook of the National Society for the Study of Education^ 
1919, part II, p. 111-23. 

Account of the use of the test in the dcmentary schofrfs and with adultk Mr. Seaahocc ttatit 
that the best time to use the chart is in the fifth grade. 

Seashore, C. £. The psychology of musical talent, Boston: Silver 
Burdett and Company, 1919. 

The system of evaluation of musical talents is reviewed and a chapter is devoted to each of tht 
five double disk records. 

Seashore, C. E. Vocational guidance in music, (University of Iowa 
Monographs, ffi^t series, no. 2, September, 1916.) 

Copies may be obtained on request from the librarian oi the University of Iowa, Iowa Gtj, 
Iowa. A discussion of the value of the Musical Talent Chart. 

"Testing for musical talent," Musician, 24:10, July, 1919. 

A discussion of Seashore's tests. 
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XI. Pbysical Training 

Athletic Badge Tests for Boys. These tests are not a complete meastire of 
physical efficiency^ but they serve as a fair index of heart, lung, and 
muscular development. They comprise a sixty-yard dash, standing 
broad jump, and a pull up. Standards have been worked out. These 
tests have been used in the high schools of Gary, New Orleans, Seattle, 
Buffalo, and New York. 
Publisher: Playground and Recreation Association of America, 1 Madison 

Avenue, New York City. 
Reference: Hanmer, L. F. Gary pMic schools: physical training and 

play. New York: General Education Board, 1919. 

Athletic Badge Tests for giris. This test is similar to the one for bojrs, but 
being a newer series has no standard. 
Publisher: Playground and Recreation Association . of America, 

1 Madison Avenue, New York City. 
Reference: Hanmer, L. F. Gary public schools: physical training and 

play. New York: General Education Board, 1919. 

Mr. Hanmer itates: "The results (for the girls) are therefore no more latisfictory than the 
results of the bojrs' test. There is also the same unevenness and irregularity in development." 

Baldwin's Physical Development Scale. Separate scales are given for bojrs 
and girls. Each scale gives norms for height, weight, and breathing 
capacity for each year from the kindergarten to the last year of the high 
school. This scale is included in Rapeer's Scale for Measuring Physical 
Education. 

Address: Bird T. Baldwin, University of Iowa, Iowa City, Iowa. 
Reference: Baldwin, B. T. "A measuring scale for physical growth and 
physiological age," Fifteenth Yearbook of the National Society for 
the Study of Education, 1916, part I, pp. 20-21. 

Rapeer's Scale for Measuring Physical Education. This is a score card for 
judging five aspects of the results of physical education, i.e., health, 
physiological efficiency, physical devdopment, physical ability and 
mental qualities. 
Address: L. W. Rapeer, 1719 H. Street N. W., Washington, D. C. 

Xn. Reading 

Kansas Silent Reading Tests. Test III of this series is designed for the high 
school. It consists of a series of exercises in which the pupil b asked to 
read a short paragraph and answer a single question on it. The adminis- 
tration of the test is very simple and it has been very widely used. 
Publisher: Bureau of Educational Measurements and Standards, Kan- 
sas State Normal School, Emporia, Kansas. 
References: Kelly, F. J. The Kansas Silent Reading Test (Studies by 
the Bureau of Educational Measurements and Standards, No. 3), 
Emporia, Kansas: Kansas State Normal School, 1915. 

This contains the complete account of the doivation of the test. 
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Kelly, F. J. The Kaasas alent veidmg test," J^muai #f E imcaHwmal 
Psyckdcfy, 7:63-ff), Febraaxy, 1916. 

Tkb ii a putBl aoooMt «l the 4cmatin «l the tot. 

Monroe, Walter S. ^A report cm the use of the Kansas silent reading 
tests with over one hundred thousand diildren," J§mma! of Edmca- 
Hanoi PsyckoUtjf 9:600-8, December, 1917. 



■pMisteal 

Smith, B. M« ^'Corrdation oi ability in reading with the general grades 
in hi^ school," SchoU Raiem, 27:493-511, September, 1919. 

la tiyBic to < liln i iiif the conefatina btl w ata abiBtia m Ra£BC sad achooi abStks m the 
Obk Paifc, DfiBoit. I%h achooi Hm SMth and the Knaw SikDt EfiMfiac smI tkne 



An edncaUonal survey oj JantsmBe, Wisconsin. Madison, Wisconsin: 
State Department of PabHc Instruction, 1918, p. 261. 

Aa aoooaat ol the aae ol the 



Monroe's Standardized Silent Reading Tests. This series of sQent reading 
tests is essentially a revision of the Kare>as Silent Reading Tests de- 
scribed above. 
Publisher: Bureau of Educational Research, University of Illinois, 

Urbana, Illinois. 
Reference: Monroe, Walter S. ''Monroe's standardized reading tests," 

Journal of Educational Psychology, 9:303-12, June, 1918. 

Tbb is aa accoaat of the deriratka oC the reirnkm. The Cansaa Siknt Reatfiaf Tests have 
matefiaL la the icriiiaB the paxasiapfat have beea selected from school readen. 

School report of the town of Southington, Connecticut^ 1919, p. 17. 

Aa accoaat of the use of these tests ia the high schooL 



Heher's High School Vocabulary Scale. A test consisting of one hundred 
words chosen from the top of every third column of Laird and Lee's 
Vest Pocket Dictionary. 

Address: H. L. Neher, Northwestern University, Evanston, Illinois. 
Reference: Neher, H. L. "Measuring the vocabulary of high school 
pupils/' School and Society, 8:355-59, September 21, 1918. 

Reproductioo of the test, sooies obtaaaed thraogfa ezperinacatatkn aad con d asio m ccachcd. 

St. Paul Survey Sflent Reading Scale for High SchooL This scale is similar 
to Minnesota Scale Beta, the derivation of which is based on Thorn- 
dike's Scale Alpha 2. 

References: Report of a survey of the school system, Si, Paul, Minnesota, 
1917, p. 375-401. 

The tests and questions are repfodnced. Methods of scoring aad a comparison of scans is 
also given. 

Haggerty, M. £. and Thomas, M. J. "Preliminary study of the reading 
attainments of college freshmen," School and Society, 6:230-38, 
August 25, 1917. 

The test was given to theooUege fztshmen and was also given to two hundred and fifty memben 
of the senior class in the St. Paul high ichooL The test which is reproduced in this article indndes a 
Bomber of the ezerdses from the St Paul Svrvej Test 
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Smith's Sflent Reading Paragraphs for High Schools. Miss Smith has 
devised three informal silent reading tests. The tests are as follows: 
Test /. Paragraph Test, Ability to grasp central idea. Four paragraphs 

were chosen from "A Father to His Freshman Son in College," 

(Atlantic Monthly). 
Test II. Information Test. Ability to recall items of information. 

Selections were taken from the Independent. 
Test III. Narrative Test. Ability to follow plot. Selection was a story 

from an inside page of Chicago Daily Tribune. 
Address: Bertha M. Smith, Oak Park High School, Oak Park, Illinois. 
Reference: Smith, B. M. ''Correlation of ability in reading with general 

grades in hij^ school,'' School Review, 27:493-511, September, 1919. 

The tcsU were given to determine the corrdation between abilities in readinf and school 
abilities. The four reading tests used are described and the author's three tests are reproduced. 

Starch's English Vocabulary Test. This test is designed to measure the 
percent of words of the entire English vocabulary as well as the absolute 
number of words that a person understands. The test consists of several 
sets of one hundred words which were selected at uniform intervals from 
the entire English vocabulary — ^Webster's New International Dic- 
tionary. 

Address: Daniel Starch, University of Wisconsin, Madison, Wisconsin. 
Reference: Starch, Daniel. Educational measurements. New York: 
Macmillan, 1916, p. 38 ff. 

The test ii reproduced. Tentative scores are shown for different grades in the high school as 
wdl as for dementary school and coHege. 

Thomdike's Scale Alpha 2 for Measuring the Understanding of Sentences. 
This scale consists of a series of paragraphs and questions about the 
paragraphs arranged in order of difficulty of comprehension. This scale 
measures only the degree of comprehension and does this in terms of 
difficulty of the exercise which the pupil is able to do 80 percent correctly. 
Part II may be used in grades VI to xn. 

Publisher: Bureau of Publications, Teachers* College, Columbia Univer- 
sity, New York City. 
References: Thomdike, E. L. ^'Improved scale for measuring ability in 
reading," Teachers College Record, 16:445-67, 17:40-67, November, 
1915, January, 1916. 

The test, key and score sheet are reproduced in the November issue along with the discus^on of 
the use of the scale method of scoring, and the interpretation of scores. The derivation of the 
test is in the November number. 

Kelley, T. L. ''Thomdike's reading scale alpha 2 adapted to individual 
testing," Teachers College Record, 18:253-60, May, 1917. 

Directions for using the scale with individual rather than with the class as the author intended. 

Xni. Sgebncb 

A. General 
Caldwell's Science Tests^ The tests may be divided into three groups. 
Group I consisting of two pairs of tests deab with observation and dis- 
crimination. Group n relates primarily to the pupil's ability to recog- 
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M^ereiux: Ham%, J, P. "Measnreaeais of some ibflinrs 
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E«db*» ^MMf «f IsforaMtSoa Test m Gcacnl Srifre TUs test consists of 
fdiy ftckottfic terms assembled upoo the basis of freqaency in fenenl 
ittjtefitjt texu. As three series of words are gnren, a different series may 
\Mt prtn during the year, 
Addf€$$: G. M, Ruch, School of Education. University of Orecon, 

Eufene, Oregon, 
fUjerenit: Ruch, G, M. "A range of information test in 

Mienct** General Science Quarterly, 4:257-62, November, 1919. 

f AMutt^ Ubt dcrWfttiim <rf Utt ust vUck M npfodsccd. Tke netkid far Koriag b • 



B. Chemistry 
Bttt's Flrit^TMr Chemistry Test. A test of 25 questions which the author 
considered basic for elementary chemistry. 

Kejerenui: Bell, J. C. "Study of the attainmenU of hi^ school pupik 
in first-year chemistry," School Science and Mathematics, 18:425-32, 
May, 1918, 

MfM iccowil of lu d«fir»tkm. R«Mlt* fram 401 pupib aiMljaed. 
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Bell, J. Carleton. ''A test in first year chemistry/' Journal of Educa- 
tional Psychology, 9:199-209, April, 1918. 

This is the complete report of which the above is a pretinunary statement. 

Jones' Chemistry Tests. (Union Science Series, See Physics.) 
Address: F. T. Jones, 10109 Wilbur Avenue, Cleveland, Ohio. 

Rivett's Time Limit Test in Chemistry. The article presents two t3rpes of 
simple tests which are arranged for beginners. They are intended as 
suggestive types of tests which teachers of chemistry may easily devise. 
The pupils may score these tests themselves. 

Address: B. J. Rivett, Northwestern High School, Detroit, Michigan. 
Reference: Rivett, B. J. "Testing results in chemistry," School 
Science and Mathematics, 19:742-45, November, 1919. 

Two types of tests are reproduced. Advantages over the old form examination are stated in 
conduuon. 

Webb's Preliminary Test in Chemistry. Test requires pupils to classify 
fifty well-known substances as elements, compounds, or mixtures. 
Address: Hanor Webb, George Peabody College for Teachers, Nashville, 

Tennessee. 
Reference: Webb, Hanor. "A preliminary test in chemistry," Journal 

of Educational Psychology, 10:36-43, January, 1919. 

This is an account of the use of the author's test with a number of Us classes. 

C. Geography 
Boston Geography Test. A forty-minute test on United States and the 

countries of Europe. Although the tests were given to elementary, high, 

and normal school pupils, particular interest centers in the results 

achieved by the eighth grade. 

Address: Leonard 0. Packard, Boston Normal School, Boston, Massa- 
chusetts. 

Reference: Geography, A report on a preliminary attempt to measure 
some educational results. (Bulletin No. 5 of the Department of 
Educational Investigation and Measurement, Boston Public 
Schools, 1916.) 

Discusstcm of the tests with reproduction, but method of giving and of rating is not shown. 
Results for high-school students are given. 

D. Physics 
Chapman's Physics Test in Electricity and Magnetism, Sound and Light. 
Address: J. Crosby Chapman, Western Reserve University, Cleveland, 

Ohio. 
Reference: Chapman, J. C. "The measurement of physics information," 
School Review, 27:748-49, December, 1919. 

The test with answers is reproduced. Results for 158 high-school pupils are tabulated. 

Jones' Union Science Tests. These tests form an elaborate series covering 
many of the topics of the subject. There is a separate test for each topic. 
Address and send results to: Franklin T. Jones, 10109 Wilbxir Avenue, 
Cleveland Ohio. 
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Reference: Jones, F. T. "Practice exercises in physics," School Rniem, 
26:341-48, May, 1918. 

Deicribcs the Unkm Scknce Test»— ft Kries in physics. Test Hy-Tcst Bt, and Test Ha are 
repndiiced, with xesolts aneljrsed. 

Bandall, Chapman and Sutton's Test in Mechanics. A simple test of a sat 
of progressive problems in mechanics. 

Address authors: Western Reserve University, Cleveland, Ohio. 
Reference: Randall, D. P., Chapman, J. C. and Sutton, C. W. "The 

place of the numerical problem in high school physics," School 

Review, 26:39-43, January, 1918. 

Theteftisicprodqced. Results from experimental testing with four high schoob are given. 

Starch's Physics Test. This test is composed of 75 sentences which are 
arranged in the form of a completion test. The degree to which the 
pupils have mastered the work in ph3rsics covered by these sentences is 
shown by their ability to fill in the missing words, phrases, and nimibers. 
The test is broken up into topics and standard scores for each topic are 
printed on the test sheet. There are 28 sentences on mechanics, eight on 
heat, nine on light, and 21 on magnetism and electricity. 
Publisher: Daniel Starch, University of Wisconsin, Madison, Wisconsin. 
Also obtainable from Bureau of Educational Research, University of 
Illinois, Urbana, Illinois. 

Reference: Starch, Daniel. Educational measurements. New York: 
Macmillan, 1916, chapter XIV. 

XIV. Vocational Subjects and Manual Training 

Leavhf 8 Preliminary Test for Manual Arts. As the title suggests this is only 
a preliminary test, not designed by the author for general use. 
Address: F. M. Leavitt, Associate Superintendent in Charge of Voca- 
tional Ekiucation, Pittsburgh, Pennsylvania. 

Reference: Leavitt, F. M. ''Standardized measurements in the field of 
industrial arts," Industrial Arts Magazine^ 8:132-8, April, 1919. 

Brief discussion of methods o! prodndng tnd using standardiied tests is given. The preliminary 
scale for manual arts is reproduced. 

Wardner's Test for Knowledge of Tools. This is a modification of one of the 
Army Trade Tests. Pupils are asked to identify 81 tools. Test is 
reproduced. 

Address: C. A. Wardner, Director of Cooperative Trade Schools, 
Springfield, Vermont. 

Reference: Wardner, C. A. "Applying the army trade tests to vocational 
schools," Industrial Arts Magazine, 8:402-03, October, 1919. 

A reproduction and brief discussion of this test which is being used in the Cooperative Trade 
School. SpringSdd, Vermont 

(The End) 



In the spring of 1919 the General Education Board 
National appropriated $25,000 to the National Research Council to 

Intelligence be used for the preparation of methods of measuring the 
Tests intelligence of children in the elementary schools. A com- 

mittee consisting of Dr. M. £. Haggerty, Dr. L. M. Terman, 
Dr. £. L. Thorndike, Dr. G. M. Whipple, and Dr. R. M. Yerkes, Chairman, 
was organized to undertake this task. 

This committee has prepared two scales, the tests of which are listed 
below. 

Tests of Scale A Tests of Scale B 

Arithmetical Reasoning Computation 

Sentence Completion Information 

Logical Selection Vocabulary 

S}monym-Antonym Analogies 

Symbol-Digit Comparison 

Either of these scales may be used alone, but the committee expects to 
recommend re-examination by the second scale after an interval of at least 
one day, in order that the reliability of the intelligence measurement may be 
increased. It is deemed preferable by the committee to use two short scales 
in the way suggested, rather than to uat a single longer scale, the application 
of which would require approximately an hour of continuous work. Examina- 
tion by either of the proposed scales, A or B, will require approximately thirty 
minutes. 

Materials have been prepared by the committee for ten alternative forms 
of each of the ten tests which have been selected for use, but it is planned to 
complete for immediate publication only five forms of each test and of each 
scale. The remaining materiab will be held subject to later development as 
neeued* 

It has been arranged that the World Book Company of Yonkers, New 
York, shall publish these new tests under the title "National Intelligence 
Tests." It is expected that the materials, which will consist of record blanks, 
examiner's guide, and scoring keys, will be ready for distribution in the 
spring of 1920. Royalties from the publications will be used for further 
research on methods of measuring intelligence and the practical application 
of such methods. 

Robert M. Yerkes 

Chairman 
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The condusioiis of E. J. Ashbaugh concerning the necessity of teaching 
derived fonns in spelling^ have been confirmed by the results obtained in tests 

given by the Department of Educational Investigation and 
Need to Teach Measurement, Boston, Massachusetts. While his data are 
Sprung of based on tests given in the lower elementary grades (n to 

DeriTatlvei v), the data of this department are based on results obtained 

in grades VI and vn. There is also this difference in the two 
investigations. The words tested by Ashbaugh may or may not have been 
studied by the pupils since the tests were not organized on that basis, while 
in the Boston tests the root words given were specifically chosen from the 
Boston minimum spelling list which the pupils had studied. 

Undoubtedly the adding of a suffix to a word makes that word 
harder to spell and we have no right to presuppose that pupils can spell 
derived words the roots of which they are able to spell. This is shown con- 



COMPARISON OF ROOTS AND DERIVATIVES 

(All root :97ords occur in sixth-minimum list) 



Root Worc1» 


Percent 


Derivatives 


Percent 




Correct 




Correct 


abbreviate 


78 


abbreviates 


75 


absence 


85 


absences 


75 


accidents 


90 


accidents 


77 


arrange 


92 


arranging 


86 


attack 


94 


attacked 


87 






attacking; 


94 


boundary 


87 


boundanes 


67 


century 


93 


centuries 


77 


commence 


85 


commenced 


81 






commencing 


74 


conc^uer 


89 


conc^uered 


80 


deceive 


80 


deceiving 


70 


decide 


87 


decided 


85 






deciding 


76 


describe 


82 


describing 


76 


industry 


96 


industries 


79 


judge 


98 


judges 


93 


material 


84 


materials 


73 


mosquito 


94 


mosquitoes 


59 


recognize 


87 


recognized 


85 


return 


98 


returned 


93 






returning 


95 


salary 


96 


salaries 


77 


telegraph 


98 


telegraphed 


90 


telephone 


98 


telephoned 


95 


ventilate 


87 


ventilated 


85 


wharf 


99 


wharves 


69 



> Reported at February 1919 meeting of the National Aaodation of Directors of Ednmtional 
Research and in Jomnal of BducaUonal Psychohgy, March, 1919, p. 143. 



April, 1920 NEWS ITEMS AND COMMUNICATIONS 323 

dusively in the results of spelling tests given in Boston in 1916,' 1917, and 
1919. In each of the years 1916 and 1917 a seventh-grade division of approxi- 
mately 1,000 puiHls was given a list of root words to spell; another seventh- 
grade division was given derivatives of these same words; i.e., the first 
division spelled such words as "health," "accurate," and "promise," while 
the second division spelled "healthy," "accurately," and "promised." 
With few exceptions there was a falling off, and in some cases a very large 
falling off, in the percent of accuracy with which the derived forms were 
spelled, even in cases where the difference in spelling was only the addition of 
"s" or "ing" with no change of the existing root. 

As a result of these findings the teachers were urgQ(|^to teach in their 
spelling lessons the more common derivatives in connection with the root 
word. 

In the spelling test of May 1919, 35 sixth-grade classes spelled the follow- 
ing list of 23 root words (all included in the sixth-grade minimum list) and 
27 derivatives of those words with the percent of accuracy indicated in the 
table on page 322. ^ ^ 

In every casejl)ut one ("attacking") the derivative proved itself a harder 
word to spell even though the teachers had been urged to teach the common 
derivatives. Svitcjt it is as important that the pupils know how to spell such 
common Wbr4s as "judges," "mosquitoes," etc., as well as the root words, 
every ^bon^non derived form must be considered as presenting a new spelling 
problem and must be taught of such, 

^ * Hassiet M. Basthelicess 

• 

The Seventh Annual Conference on Educational 
Conference on Measurements will be held at Indiana University, Friday 
Educational and Saturday, April 23 and 24. Indiana University was 
Measurements the first institution to hold an annual conference on 

educational measurements. These meetings are well at- 
tended by the school men of the state; and the university has brought to this 
meeting year after year speakers of national reputation. The committee in 
charge of the conference this year has issued the following preliminary an- 
nouncement: 

"The principal speakers for the Seventh Annual Conference on Educa- 
tional Measurements wiU be Dr. Edward L. Thomdike of Teachers College, 
Columbia University, and Professor C. E. Seashore of the University of 
Iowa. Dr. Thomdike's discussions will be along the general lines of intelli- 
gence examinations for college entrance, standardization of textbooks, and 
the dangers of indiscriminate use and misuse of educational tests. Professor 
Seashore, who has done some remarkable work in the particular field he wiU 
present, will bring to the Conference the results of his research in the measur- 
ing of special abilities, particularly the measiuing of ability in music." 

* See Bulletin XI of the Department of Educational Investigation and Measurement, Boston, M 
chuaetts. 
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A number ordifferent types of tests have been devised for measuring the 
silent reading vocabulary of pupils. The best known of 
Sootfaington- these probably is the Thomdike*s Visual Vocabulary Scales 
Plymouth A2 and B. In these the pupil is asked to indicate the class 

Bnfjish to which the word bdongs as flower, animal, or boy's name. 

Vocabulary In other vocabulary tests, the pupU is asked to check the 

Scale words he knows the meaning of and to write out the meaning 

of those concerning which he is uncertain. Both of these 
plans have obvious limitations. The Southington-Plymouth English Vocabu- 
lary Scale devised by Ernest C. Witham makes use of a different device. 
Fifty English words are given. On the opposite page their brief definitions as 
given by Webster's InUrnaiional Diciianary are printed. The pupil is to 
record before each definition the number of the word which it fits. 

Most of the words were selected from Ayres Spelling Scale. A few 
additional words were taken from Thomdike's Visual Vocabulary Scale A2y 
series x. The test has been tentatively standardized for the eighth grade 
and the high school. Copies of the test can be secured by addressing Superin- 
tendent Ernest C. Witham, Southington, Connecticut. 

Mr. George N. Cade, Supervisor of Elementary Grades, 
Classifying Springfield, Illinois, gave Monroe's Standardized Silent 

Pupils in Reading Test II to the vmA pupils who were promoted to 

English high school at the end of the first semester. The principal of the 

high school has classified these pupils in the English depart- 
ment on the basis of their ability to read silently as shown by this test. 
Since ability to read silently is fundamental to practically all of the work of 
the high school, classification of pupils on the basis of this ability may be 
expected to effect a helpful organization. 

The Myers Mental Measure by Caroline E. Myers 
A Non- Verbal and Captain Garry C. Myers, claimed by the authors to be 
Intelligence the first group intelligence test applicable to all ages, is 
Test recommended for iise in every grade since the directions are 

given orally and since the exercises consist wholly of pic- 
tures. It can be given to illiterates as well as to those who can read. The 
time for giving it is not more than twenty minutes. The publisher is The 
Sentinel, Carlisle, Pennsylvania. 

Professor M. E. Haggerty of the University of Minne- 
The Virginia sota devised for use in the Virginia School Survey two tests 
School Survey of general intelligence, Delta 1 for grades one to three and 
Tests Delta 2 for grades three to nine; and a test for measuring 

achievement in reading, Sigma 1 for grades one to three. 
These tests have recently been published and made available for general use 
by the World Book Company of Yonkers, New York. The tests are accom- 
panied by a manual of directions and ke3rs for scoring. Their use in the 
Virginia Survey and in a number of cities ebewhere in the country insures 
their standardization. 



^attxinal AaBnnatton of SBtr^rtxtra of 

lEbitratixtnal S^B^arrlf 

(E. J. AsHBAUGH, Secretary and Editor) 



Even though it is several weeks since the meeting of the Department of 
Superintendence at Cleveland, this is the first opportunity to tell you, who 
were not fortunate enough to attend, something of the meetings of our 
association at that time. 

The first annual closed meeting on Monday was a decided success. 
Although conflict of time with the meetings of the College Teachers of 
Education prevented a few members from attending, the number present was 
quite satisfactory and the program even more so. Though announced as a 
dosed meeting, nothing short of a corporal's guard would have kept some 
interested non-members out. It was more than curiosity on their part, since 
once inside they remained throughout the meeting. 

The forenoon was given over to the report of the Committee on Standards 
(Mr. Courtis, Chairman) and a paper on ''Diagnosis" by Mr. Kallom of Boston, 
the paper being presented by Miss Barthelmess in his absence. The report 
of the Committee on Standards attempted to accomplish its task by: (1) 
pointing out the problems to be solved, the ends to be achieved; (2) indicat- 
ing so far as is at present possible the criteria to be used in judging of values; 

(3) providing an incentive to induce workers to apply these criteria; and 

(4) leaving it to a process of natural selection to determine which method 
shall survive. The association plans to make available to all its members as 
well as to the public the terms, methods, and practices approved. The asso- 
ciation passed a motion for the reorganization of the committee with provision 
for subcommittees in a number of special fields. 

The paper on ''Diagnosis" set forth the method the Boston department is 
using in acquainting the assistant superintendents and masters with the 
position of classes relative to dty standards. Although, as a result of these 
reports, considerable effectiveness is being registered in the teaching; it was 
admitted by the speaker that as yet the department has been unable on 
account of lack of resources to accompany its reports to the teachers with 
suggestions as to remedial measures. 

At 12:30 luncheon was served in "our" private dining room. Thirty of the 
members and their guests partidpated. 

The afternoon program induded two papers on "The Evaluation of Tests" ; 
one by Dr. Monroe and the other by Dr. T. L. Kelley. Both speakers led the 
members into a very deep discussion of the need for the statistical methods 
involved in the determination of the validity and reliability of tests. It 
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i nv o lv e d a consideratkMi of tecfank impo«bie for the majority of as to 
practice but represen t ed a phase of the testing work in whidi far too little 
has been done. 

President Bnrkingham gave the members a brief history of the evolu- 
tion of our oflidal organ, the Joushal of Educational Research. We were 
ddighted to learn that it is exfyitding the hopes of its founders, that it is 
already on a self-sui^x>rting basis, and that the first issue has to be re- 
printed to supply the demand for it. 

At six o'clock we again broke bread together in the comfortable adjoining 
room which the hotel management had assigned to us. By this time we 
fdt as if we owned it. 

On Thursday a program consbting of eleven numbers was presented. 
Judging from the attendance and the comment of those who heard our 
offerings, the program was a success. Most of the papers will be published 
in the Journal of Educational Research. 

President Brown of Oshkosh led off with his paper on "Formulation of 
Method in Reading in the Light of Recent Investigations." As the chainnan 
said in his introduction, Mr. Brown is a conspicuous example of a school 
man who has become an executive without ceasing to participate in research 
work. The morning program was organized about the topic of reading, and 
Mr. Brown's paper afforded a good introduction to the work of the morning. 

Dr. Theisen handled the subject o( ''Provisions for Individual Differences 
in the Teaching of Reading" in an effective manner. He has gathered mater- 
ial from more than one hundred teachers on the provisions which they are 
making and the provisions which they feel ought to be made for adjusting 
the teaching of reading to differences in ability among children. The report 
was interesting because it showed just what the teachers are thinking about 
on the important matter of fitting instruction to the needs of pupils. 

Mr. Kallom was to have presented a paper on ''Reproduction as a Measure 
of Ability." He was, however, at the last minute, obliged to remain at home 
on account of illness in his family. We were sorry indeed not to greet Kallom 
but his paper was so capably presented by Miss Barthelmess, his assistant at 
the Boston Department of Research, that we almost forgot our disappoint- 
ment. The point of the paper was that children reproduce what they have 
read in terms of their experience. Some of the responses of children were 
interesting not only from a scientific point of view but also were worthy of a 
place among the "bright sayings" of children. 

Doctor — or shall we say Colonel — Ayres dodged the use of slides and 
brought his own charts. This was a wise precaution on his part, for we were 
having trouble with our lantern. These charts he comfortably set up and 
proceeded to offer an admirable paper on "The Comparative Effectiveness 
of State School Systems." He began by going back to 1750 at which time an 
Italian article was published on the high cost of living. In this article index 
numbers were used practically as they are now employed in economics. The 
speaker discussed the meaning and use of the index number and showed how 
it could be applied in education. He made the application on eight items to 
the schools of each of the states. These states were ranked on the basis of 
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each of the eight items according to their index numbers. Comparisons were 
also made with Dr. Ayres' previous study of conditions in 1910. 

Last year, our association authorized a committee on standards. The 
president, however, seemed to have been particularly successful in selecting 
men who were about to retire from research work and from membership in 
the organization. The committee had no opportunity, therefore, to work 
out a real committee report. Mr. Courtis, however, as chairman, deter- 
mined to have a report, so he wrote one himself. This he presented in part as 
the first number on the afternoon program. While certain recommendations 
were made for the guidance of the association and through it for the guidance 
of research workers in general, the paper consisted largely of the presentation 
of evidence to show that we really do not know exactly what our tests mea- 
sure. As an indication of the ansdysis to which our testing instruments must 
be subjected, the paper was important. 

Dr. Thomdike was to have presented a paper on "Intelligence Tests for 
College Entrants." He was, however, imable to attend — and again we have 
the ''flu" to thank for his inability to respond. Dr. Thomdike sent his paper 
but, owing to the shortened program consequent upon the delay in getting 
started, the paper was not read. It will be published in an early number of 
the Journal of Educational Research. 

Mr. Dickson — Dickson all the way from the Coast — gave a report on the 
use of intelligence tests in the classification of eighth and ninth-grade pupils. 
He demonstrated the reliability of these tests as administrative devices for the 
homogeneous grouping of pupib for educational guidance, and for providing 
specialized instruction for superior children. 

Mrs. Fleming of the Wisconsin State Department presented her paper on 
''Reading Ability and Intelligence." Mrs. Fleming had results on the use of 
the Thorndike reading test in Wisconsin and Virginia. From the Wisconsin 
results she is tempted to conclude that there is a close correlation between 
reading ability and intelligence but the Virginia results seemed contrary. 
While not entirely committing herself, she seemed to feel that such correla- 
tion did exist wherever regular school attendance and emphasis upon reading 
were generally operative. 

Dean Kelly presented [-a study of "Three Methods of Teaching the 
Fundamentals of Arithmetic." The methods were by use of (1) Courtis 
Practice Tests; (2) Studebaker Practice Tests; (3) Usual teacher-devised 
drill material. The results were definitely favorable to scientifically devised 
practice material, the "Courtis" getting, in general, the greatest gains for 
classes but the "Studebaker" evidencing greater corrective effect. 

Mr. Burgess, one of our new members in the Russell Sage Foundation, 
presented "A Trend Analysis of Teachers' Salaries." By a study of the 
wages of skilled and unskilled laborers and of rural and dty teachers during 
the past century and by converting the wages into index numbers, he showed 
the following facts: (1) wages of one kind follow the trend of wages of another 
kind much more closely than they do the cost of living, (2) wages of skilled 
and unskilled labor respond more quickly in economic crises than do teachers' 
salaries, (3) rural teachers' salaries and wages of unskilled labor tend to be 
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nearly equal except in times of crisis, (4) city teachers' wages tend to follow 
the same general curves as those of rural teachers and of skilled and unskiUed 
laborers; but they lie between the wages of the last named groups, (5) times 
of high prices show a decided drop in the index of teachers' salaries. 

Mr. Richardson showed some results attained by ''The Campaign 
Method in Elementary Education" with special reference to arithmetic work 
in the four fundamental operations with whole numbers. The method con- 
sists of taking individual results directly to each child and interesting him in 
making a record for himself. Practice examples were furnished the pupils. 
Although the campaign was carried on for a few weeks only, results showed 
large and permanent gains. 

The Fifth Annual Banquet and the evening program were the climax of 
the week to the members of our association. More than forty members and 
guests were present. Serious thought and kindly humor characterized the 
evening to the delight of all. 

Following the practice of the past, the secretary presented one name for 
election to honorary membership. The association honored itself this year 
by electing Dean Wm. F. Russell of the College of Education, State Univer- 
sity of Iowa. Dean Russell responded to the election with a striking allegory, 
portraying the evolution of the school superintendent in terms of the chauf- 
feur. 

Mr. Packer presented very briefly the need of a definite administration of 
supervisory work through a department of research. Such a plan is now in 
operation at Detroit. By this means, he said, much supervision which is 
ordinarily wasted, may be applied where it is most needed. His plan contem- 
plates the fuUer recognition of the building principal as a supervisor. 

Dr. Rugg spoke on the necessity of scientiflcially devised text books as 
the solution of much of the present school inefficiency — a solution which can 
be applied even before we have an adequately trained body of teachers. 

The first annual presidential address was given, summarizing the progress 
of the past year in the fields of particular interest to our membership. The 
magnitude of this progress was surprising to most of us. 

At the business meeting, the following officers were elected for 1920-1921 : 
President, M. E. Haggerty, Director of Bureau of Co-operative Research, 
University of Minnesota; Vice-president, Virgil E. Dickson, Director of 
Research and Guidance, Oakland and Berkeley, California; Secretary- 
Treasurer, E. J. Ashbaugh, Director of Bureau of Educational Service, State 
University of Iowa, Iowa City, Iowa. 

Much of the business so far as discussion was concerned had been con- 
ducted at the closed session on Monday. Accordingly matters were disposed 
of quickly. In addition to the election of officers, the president was author- 
ized to appoint a committee with power to act in the matter of affiliation with 
the National Research Council. He was also requested to appoint a perma- 
nent Standardization Committee and a committee to decide the day of the 
convention week on which our closed session shall hereafter be held. Dues 
were raised from $2.00 to $3.00 beginning with 1921. 
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INTELLIGENCE EXAMINATIONS FOR 

COLLEGE ENTRANCE* 

Edward L. Thorndike 
Teachers College, Columbia University 

For an ideal examination of the intelligence of candidates for 
college entrance we might set the following specifications: 
I. Significance. — The score should correlateTas closely with 
future achievement in college as is possible. This maxi- 
mum possible correlation will not be 1.00, since achieve- 
ment in college is due in part to health, to freedom from 
personal worries, and to various moral qualities as well as 
to intellect. Also, the magnitude of the correlation co- 
efficient will depend on the range of the intellect of candi- 
dates, being smaller as that range is restricted. If all the 
eighteen-year-olds in the country were educated for college, 
tested, and given a trial in college, we might perhaps 
expect a maximum correlation as high as 0.75 to 0.85. 
Within the restricted range of those who complete a high- 
school course and actually become candidates, we may 
expect as a maximum 0.55 to 0.65, possibly more. A 
correlation above 0.50 is probably an improvement over 
the attainment of standard systems of accrediting high 
schools or of entrance to college by examination in school 
subjects. 
II. Continued significance. — The correlation should maintain 
itself year after year after the nature of the intelligence 
examination is known in spite of whatever coaching 
candidates undertake. This implies, in theory, that such 

* A paper prepared for presentation before the National Association of Directors 
of Educational Research at its meeting at Cleveland, Ohio, February 26, 1920. 
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special coadzing shjn ghr tninmg that is neaziy 
future coQegt aclncvciDcnt as for sorrrsp» in the test, or that 
the tendeno' to nndcnake. and the afatfitv to profit by 
such special ooacfaing shall be very dasdy condated with 
ahifit>' to achieve in college. In iKactke, it means that 
the examinations vear after vear should be totaDv different 
in content until a great many of them are availaUe; and 
shoold din er in form where there is danger that adaptatkm 
to the form of the examination may enable a dull boy to 
secure a good score, 
m. Comparabiliiy of standards and resmlis. — (a) The cxamina- 
^ tions given year after yezi should be dosely equal in 
difficult}", (h) the scoring should be by standard keys so 
that the same paper scored by different examiners will 
receive substantially the same score; (c) the administra- 
tion of the examination should be siin{^ and independent 
IB of the personality of the examiner. 

rV. ProhabU error of the examination itself. — For the examina- 
' tion's main purpose, the probable error is already taken 
f accoimt of in the correlations with college success. For 
I that purpose, in fact, a large probable error would be 
encouraging, for it would mean that by repeating the 
examination, using a different form, the correlation with 
college success could be notably raised. For certain special 
purposes such as comparing individuals or groups, and for 
the justification of shortened forms of the examination, the 
smaller the probable error the better. 
A half-year's experience with the Thomdike Intelligence Exam- 
ination for High School Graduates may increase our confidence 
that these specifications may be met to a rather close approxima- 
tion. This examination was dexased at the request of the faculty 
of Columbia College, where it is an optional means of entrance for 
boys suitably recommended. Three forms of it have been used to 
date by Columbia, one in June 1919, one in September 1919, and 
one in February 1920. About seven himdred candidates have 
taken it, though over half of these were already legally admitted 
by the content examinations of Columbia University or the 
College Entrance Examination Board or the New York Regents. 
It has also been used for various purposes by a nimiber of other 
institutions. 
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Significance 

Four yeaxs must elapse before an exact accounting on this 
point can be made, but the following facts may be noted: 

Of eleven boys at Columbia, reported to the dean's office for 
inability to do college work in the early weeks of the year, all had 
notably low scores in the intelligence examination. Of a score or 
more so reported as a result of the mid-term records, all but two 
had low scores. The defective college work of these two was by 
common consent not due to intellectual defect. 

In the case of a group of eighty odd candidates in another 
college, the correlation between the score in the Thomdike 
examination and the first term's college record was over 0.65. 
The highest 40 percent in the examination showed 74 percent of 
high grades in college work and 26 percent of low grades. The 
lowest 60 percent in the examination showed 27 percent of high 
grades and 73 percent of low grades. Of the 16 percent receiving 
the lowest grades in the examination, none received any college 
grade above C and 86 percent failed in five hours or more of their 
college work 

In a third institution, where the entire student body was tested, 
the members of the three upper classes showed no scores below 60 
in the examination, whereas a third of the freshmen (admitted by 
certificate) scored below 60. The distributions given in the 
accompanying table (Table I) give a correlation of approximately 
0.55 between test score and continuance beyond the freshman year. 
The returns received from the first and third of these institutions 
are a random selection from trials of the examination. Those 
from the second institution were reported to the writer. They 
may have been reported because of the positive evidence of the 
success of the examination, and so may be unduly favorable. 

CoNTiNTJED Significance 

If we take the best of the test material that has demonstrated 
high correlations, such as selected series of opposites, mixed rela- 
tions, and cleverly devised problems and completions, and give it 
without fore-exercise, we can undoubtedly get high correlations, 
but we may be unable to maintain them. 

Our opposites, relations, and problems of later years will prob- 
ably not be so ingenious as those which we chose first. Moreover, 
part of the first high correlation may have been due to the testing 
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of ability to understand quickly the nature of the tasks. When 
the nature of the examination becomes a matter of public knowl- 
edge to candidates, the best features of it may be lost. It will be 
specially disastrous if some candidates do and others do not know 
about it. 

Consequently, thorough precautions must be taken so that the 
examination will be as effective for twenty years as it is in its first 
trials. Our precautions are: 
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1. All test material is made up in quantities sufficient to pro- 
vide for the entire series of examinations into which it enters, and 
is distributed without prejudice among them.* The selection for 
September 1929 will be nowise inferior to the selection for Sep- 
tember 1919. 

2. Three-fourths of the candidates' time is spent on paragraph 
reading, completing sentences, tests of information, arithmetical 
and algebraic computations and problem solving, common-sense 
questions, and following directions. The nature of these tasks is 
understood in a second or two by everybody of the intelligence 
level of a high-school graduate. In examining hundreds of papers, 
I have never seen a case of misunderstanding a single one of these 
tasks. 

3. With two exceptions,* fore-exercise is given for the other 
tasks, and two trials at each task are allowed. They include such 
tests as the disarranged sentences, opposites, number-series com- 
pletions, verbal analogies, pictorial analogies, geometrical rela- 
tions, and absurdities. The nature of these is, in general, such 
that any unfair advantage to a boy whom some unscrupulous 
tutor might train in test-taking would be slight. Experiments 
are planned to measure this gain exactly. If it is appreciable, the 
examination will be extended to include ''traps'' to penalize such 
improper preparation. 

4. The content of the examination is entirely different in each 
issue. The form of the examination in the case of those tests 
where an imfair advantage from coaching is a possibility, will 
change every two or three years. 

5. Finally, no new issue will be used regularly until it has been 
tried out sufficiently to insure its giving a prophecy substantially 
equivalent to the previous issues of the examination. 

Comparability of Standards and Resxtlts 

Since each element of the examination is selected at random 

as to difficulty, the total examination, comprising over twenty 

different tests, will in any one issue of the same general type, be 

closely equal in difficulty to any other (with the exception of the 

* This is not true of the June 1919 series, which had to be arranged in part before 
the total material could be planned. 

' In the| later series it is planned to provide fore-ezerdse for these, if any evidence 
appears that it is needed to equalize matters for those who have and those who have 
not previous acquaintance with the cxaminaticm. 
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Form F k 2 points, or aboat l3^c harder than Form J. 

Thus f«g-rl=h-lH=j-2 

Pan n Fonn B and Part 11 Fonn C were each ghnen to S5 
ooOtgt students, the two groups of S5 being rand<Hn halves of a 
groctp <d 170, The two groups were tested at the same time in the 
same room, by the same ezandner, all instmcticMis being identicaL 
The median score for Form B was 81.5; lor Form C, 79.0 or a 
difference of 2.5. The 25^>ercentfle score for Form B was 58.3; 
for Fwm C 57.5 or a difference of —0.8. The 75^)axentile score 
for F<»in B was 102.7; for Form C 101.9 or a difference of 
—0.8. In general, the two distributions are dosely similar. 

We may, therefore, conclude that Part 11 C is probably a trifle 
harder than Part II B Tabout l}/^ percent).* 

Thirty-three college students took both IQ B and EQ C, axteen 
having one form first and seventeen having the other form first. 
The median of (c— b) = Ij^ points or about 2}/^ percent. 

Two examinations made up respectively of: 

IG IJ HB andmB 

IF IH nC andinC 

would thus be almost exactly equal in difiiculty for a college group. 

Twenty-three adults took both n B and 11 D, twelve having 
Form B first and eleven having Form D first. The median of 
(b— d)-4. That is, Form D is 4 points harder than Form B. 

* Tett 7 was omitted in both cases, but we know from other evidence that 11 B 7 
tad II C 7 are very dotdy similar in difficulty. 
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So, when II D is used in place of 11 B or 11 C, the other parts of the 
examination should be chosen to be a trifle easier than I G, I J, 
III B, or I F, I H, m C. 

The difference in difficulty between any two issues can thus be 
known and allowed for by transmuting the score, or, if it is at all 
large, it can be reduced by alterations in the examination and re- 
checking. This process of equalization can be applied to the 
10-percentile or 20-percentile or any other ability levels as well as 
to the general tendency of the group. 

This checking is extremely laborious and probably unnecessary, 
since differences of 3 and 4 or even of 5 and 6 percent 
in the difficulty of different issues are of little practical conse- 
quence in any uses to which the examination is likely to be put. 
However, their reduction to small amounts and an exact knowl- 
edge of these amounts make an instrument available for very 
precise comparisons. 

The scoring of all save the reading and completion tests is, 
with very slight exceptions, done by absolute keys with no re- 
quirement of judgment on the part of the scorer. The scoring of 
the reading and completion tests requires some judgment in the 
use of the keys, but the correlation between the ratings given by 
two scorers of the ability of a college instructor or assistant is 
very high. The correlation between two such scorers is 0.98. 
The probable difference between two such scorers was found to be 
only five points out of a total score which ranges from 7 to 96 
among the actual candidates whose papers were scored. These 
scorers used only the stock keys supplied with the tests. By 
having one person score one test of the six, another score another, 
and so on, the probable error for the total result of one such group 
of six would obviously be unappredable. This is the practice rec- 
ommended where the examination is used with groups of any con- 
siderable size. 

The administration of the examination consists simply of giving 
out the blanks, and instructing the candidates to go ahead at 
certain times even if they have not finished the work to date. In 
general, a candidate does test after test without awaiting instruc- 
tions. 

Improvement of the Examination 

As soon as adequate records of success in college are available, 
the correlation of each element of the examination therewith will 
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be computed together with the partial correlations where these are 
instructive. In the meantime, data are being gathered concern- 
ing the value of different available tests as ^own by their cor- 
relations with a composite score obtained in seven or ei^t hours 
of work by adults of the general intelligence level of college 
candidates. Some of the data so far obtained are of value to 
anybody who is working with group tests for adult intelligence, 
and are presented here. Lack of space forbids adequate descrip- 
tion of the tests. The following definitions apply to captions 
appealing in Tables 11 and m. 

1. 'Tart I (first half)" means the first 30 minutes work of the 

standard examination as now given. 

2. 'Tart EL'' means Part 11 of the standard examination. 

3. 'Tart m" means Part m of the standard examination. 

4. "New Part I (first half)" means a new form of Part I to go 

into e£fect in 1922. 

5. "Information" means a test of the type used in the Army 

Alpha, but harder. 

6. "Name part" means a test in writing a word that means a 

part of the thing named by the given word, and also begins 
with a certain letter. 

7. "Name opposite" means a test in writing a word that means 

the opposite of the given word, and also begins with a 
certain letter. 

8. "Name thing of which is part" means a test in writing a word 

meaning something of which the thing named by the given 
word is a part. The word written must also begin with 
a certain letter. 

9. "Name thing made of," "synonyms" and "species of genus" 

are like the above. The word written has to fulfill the re- 
quirement of being in the stated relation to the given word 
and also of beginning with a certain letter. 

10. "Sum, difference, product" means a test in giving two 
nimibers which are defined by certain relations (e.g. two 
numbers whose product is 1 and whose sum is 2). 
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TABLE n. CORRELATIONS OF VARIOUS FORMS OF GROUP TESTS 
OF ADULT INTELLIGENCE LEVEL WITH A COICPOSITE 
SCORE FOR SEVEN HOURS OF TEST WORK, IN 
THE CASE*0f'^33 college STUDENTS 



Test 



Time in 


Correlation 


Minutes 




30 


0.75 


60 


0.85 


40 


0.65 


120 


0.81 


30 


0.84 


15 


0.62 


8 


0.40 


12 


0.80 


13 


0.72 


13Ji 


0.61 


16 


0.66 


12H 


0.61 


20 


0.83 



Part I (first half) 

Partn 

Partm 

Part III 

New Part I (first half) 

Information 

Name part 

Name opposite 

Name thing of which is part 

Name thing made of 

Synonyms 

Species of genus 

Sum, difference, product 

Total Time 
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TABLE m. INTERCORRELATIONS OF VARIOUS FORMS OF GROUP 

TESTS FOR ADULT INTELLIGENCE LEVELS 
33 COLLEGE STUDENTS 





Name 
Part 


Name 
Opposite 


Thing 

of 

Which Is 

Part 


Thing 

Made 

of 


Synonyms 


Spedes 

of 
Genus 


Information 

Name part 


0.03 


0.56 
0.25 


0.53 
0.27 
0.61 


0.54 
0.30 
0.46 
0.49 


0.48 
0.30 
0.83 
0.64 
0.49 


0.52 
0.33 


Name opposite 




0.49 


Thins of which part 






0.39 


Thing made of 








0.55 


Syponyms 










0.21 

















Facts like those shown in Tables II and m are being collected 
from individuals of the intelligence level of college students as 
fast as time and facilities permit, so that no test need ever be 
used in the examination until its value has been demonstrated. 



A NEW METHOD OF RATIN G TEACHERS 

William L. Connor* 

Suptrintendemt of Schools , Repttbik, Midngan 

It is tlie teacher's task to make changes for the better in the 
abilities, habits, and attitudes of boys and girls. H& efficieiKry 
can be evaluated fairly only in terms of her success at this task. 
^ In other words, if a teacher is rated at all, she should be rated, not 
by the clothes she wears, or the method she chooses, but by the 
results she secures. 

The rating card here proposed, together with the lists of 
''concrete acts" and suggestions for use, constitutes a scheme for 
rating teachers according to the results they secure with boys 
and girls. It b not a perfect plan; but it has proved more satis- 
factory to teachers than the usual type of rating scheme in which 
personal qualities, training, discipline, attention to equipment, 
etc., take equal rank with the results secured. The studies re- 
ported in this paper were made by persons in both supervisory 
and teaching positions, who were trying to make a "promotion by 
merit" scheme work. They believe they have evolved a way of 
rating the efficiency of teaching which is better than any scheme 
in common use, but realize it is still vastly short of the ''dream of 
the scientist in education" of which CofiLman speaks :* a scale for 
measuring the efficiency of teaching. 

The stimulus to the evolution of the new rating scheme was 
the adoption by the board of education of Republic, in the fall of 
1916, of a resolution creating a uniform basal salary of $550.00 a 
year for the grades and $750.00 for the high school, and also 
empowering the superintendent to rate the efficiency of each 
teacher as a basis for determining additional compensation rang- 
ing from $25.00 to $75.00 a year. These figures were later 
increased to $650.00 and $850.00 per year and the range of the 
bonuses from $50.00 to $150.00. 

*The author appreciates and desires to acknowledge the assistance given by 
teachers, and others including the editors, of the Journal of Educational Re- 
search in the preparation of this study. 

* Cofifman, L. D. "The rating of teachers in service/' School Review Monograph^ 
No. 5, p. 14 flf., 1914. 
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Only a short time before, the scheme of paying labor according 
to the product had been adopted in the mines about Republic. 
The "bonus for merit" plan was thus readily comprehended by 
the board of education and adopted as a means of meeting the 
teacher situation. The details of the plan for distributing the 
additional compensation for merit were left to the superintendent 
to devise. As at first proposed and adopted, it was in general 
as follows: Teachers were to be rated by the superintendent and 
divided into five classes, namely, inferior, below average, average, 
above average, and superior. Teachers in the two lowest classes 
were not to receive any extra compensation, the others $25.00, 
$50.00, and $75.00 in order of merit. Later these bonuses were 
increased to $50.00, $100.00, and $150.00 a year. 

The first simple rating scheme was composed of material from 
the studies of Ruediger and Strayer,' Elliott,* Boyce,* and others, 
and was used for the first time in January, 1917. Cubberley had 
only recently written that some such plan was the most important 
means of stimulating and rewarding professional growth and 
efficiency. At the same time, he had warned that it was the 
hardest plan to put into successful operation. Other school men 
whose opinions the writer valued asked him, some jocosely, some 
seriously, if he expected to weather the storm raised by the first 
ratings. It was, then, with mingled hopes and misgivings that 
the plan was presented to teachers for their consideration and 
criticism. 

During the period when the details of the plan were being 
worked out, the teachers were being invited to examine the plan 
and were generally brought to approve its logic. At the same 
time they were warned that the rating scheme proposed for use 
was very imperfect and that the superintendent might make mis- 
takes however just he might try to be. The immediate increase 
of $50.00 a year to over half the teachers, together with the pro- 
spective increases for merit, tended to stay criticism for a while. 
This time was used in getting the teachers ready to attack the 

' Ruediger, W. C, and Strayer, G. D. ''The qualities of merit in teachers/' Journal 
of Educational Psychology, 1 :272-78, May, 1910. 

^ Elliott, £. C. "How shall the merit of teachers be tested and recorded," Educa- 
tional Administratum and Supervision, 1 -.291-99, May, 1915. 

*Boyce, A. C. "Methods for measuring teachers' efficiency," Fourteenth Yearbook 
of the National Society for the Study of Education, 1915, Part n, p. 10. 
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radng scheme; htstrart of the s<q)crinteiKlent or the logic of the 
{rian, when in doe time they should become criticaL Little by 
little they were broo^t to feel that they were aboat to co<^>erate 
in doing two of the hardest and most worthwhile things in educa- 
tion; namdy, working out a satisfactory scheme for rating the 
quality of teaching, and using the srhrme in determining a part 
<rf the pay of teachers. 

The first formal ratings were passed out in January, 1917. 
The superintendent found no superior teachers and only one 
inferior teacher. About one-fourth of the force was rated above 
average, one-half average, and one-fourth below average and 
inferior together. Bonuses were paid for the first half of the 
year. Three-fourths of the teachers received checks for $12.50 
or $25.00 with their first ratings. The expected criticisms ap- 
peared at once, but the lines for it to follow had been well enough 
drawn to confine it largely to really helpful suggestions for revising 
the rating scheme. 

After the first general rating, the teachers became intelligently 
critical and coq[>erated actively in revising the method of rating 
used. Various schemes were tried which need not be described 
here. One involved an attempt to make standard definitions of 
merit. 

A small group of superintendents and an equal number each 
of principals, supervisors, and very capable teachers were asked 
to choose, from among the teachers of their acquaintance, one 
representative of each of the five classes proposed here, namely, 
inferior, below average, average, above average, superior; and, 
then, to describe at work the teachers thus chosen to represent 
the several classes, or merit-groups, using the 'Tirst Rating 
Scheme Devised on a Cooperative Basis, 1917" as an outline for 
the description (Figure 1). Quite naturally the scheme fell 
through. We could not persuade our friends literally to write a 
book for us in their spare time. Gradually, the conviction grew 
in the minds of the teachers and the superintendent that the 
scheme gave too much credit to items only remotely related to 
the real business of the school, namely, making changes for the 
better in the behavior of boys and girls. Here I use behavior in 
the sense of aU significant mental and physical responses to all 
situations. 
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FIGURE 1. FIRST RATING SCHEME DEVISED ON A COOPERATIVE 

BASIS, 1917 

Teacher Grade or subject 

School Address Date 19 

The Teacher and Her Work 

I. The teacher 5 4 3 2 1 

A. Personal appearance 5 4 3 2 1 

B. Character 5 4 3 2 1 

C. Education 5 4 3 2 1 

D. Social efl&dency 5 4 3 2 1 

U. The government of the school 5 4 3 2 1 

A. Assignments 5 4 3 2 1 

B. Morale in the despatch of assignments 5 4 3 2 1 

C. Freedom to initiate social activities. . . 5 4 3 2 1 

D. Elimination of anti-sodal conduct 5 4 3 2 1 

III. Instruction as providing for educative activities 543 2 1 

A. Thinking 5432 1 

B. Emotional reaction 5 4 3 2 1 

C. Acquisition of knowledge and skill 5 4 3 2 1 

*D. Deportment 5 4 3 2 1 

IV. The teacher's attention to 5 4 3 2 1 

A. Health and comfort of pupils 54321 

B. Play and social life of pupils 5432 1 

C. Grounds, buildings, equipment & sup- 

pHcs 5 4 3 2 1 

*D. Professional ethics 5 4321 

Note: Qualities are designated thus: — superior, 1; above average, 2; 
average, 3; below average, 4; inferior, 5. 

• These two items were added during 1917-1918. 

While in this state of mind, the author listened to an address 
given before the Atlantic City meeting of the National Associa- 
tion of Directors of Educational Research in which Assistant 
Superintendent Allison of Chicago stated, by way of illustrating 
a point about the Boyce score card, that it was his belief that the 
correlation between personal appearance and teaching ability 
was zero or actually negative.* Another man at the same meeting 
wittily remarked: "The homely girls make the principles work, 
while the pretty ones work the principals — ^p-l-e-s and p-a-l-s, 
please note." Only recently Morton's^ study reveals much the 

* Bulletin No. 1 of the Board of Education of Chicago, November 23, 1917, con- 
tains much of the material used by Mr. Allison in this address. 

^Morton, R. L., "Qualities of merit in secondary teachers," E^KCO^umo/ i4im»ii«f- 
kaUan and Supervision, 5 '.225-38, May- June, 1919. 
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same general state of affairs. He says in one place: ''Evidently, 
then, in the judgment of the inspector, a desirable reaction on the 
part of the pupils cannot (certainly) be secured by a teacher whose 
personality and scholarship are ideal, whose methods are above 
reproach, and who teaches in a room where the physical factors 
are as they should be." In the judgment of the writer, a per- 
fectly groomed teacher of perfect physical proportions working 
with perfectly graded children in a perfect physical environment 
may and often does^ use perfectly good methods in a perfectly 
futile way. 

This rather sweeping conclusion was pretty generally reached 
by teachers in Republic in March, 1918, and it was very soon 
afterward that they adopted certain guiding principles for their 
further study of rating teachers. These principles, briefly stated, 
are as follows: 

1. Teaching, not teachers, should be rated. 

2. Teaching is measurable in terms of the results only. 

3. Results may be classified as inferior, below average, average, 
above average, or superior, only with reference to the amount 
of improvement made and the ability of the particular group of 
boys and girls to improve. 

Once these principles are accepted, four general problems 
present themselves for solution. They are as follows: 

1. Determination of a few general headings under which all 
the items of behavior the school desires to affect favorably through 
the agency of the classroom teacher can be grouped. 
. 2. Evaluation of these headings, or groups of items of behavior, 
in the desired result. 

3. Choice, from existing scales, of those which measure prog- 
ress along the lines desired, and the creation of new scales needed, 
or other means of making rough estimates of progress along lines 
where scales are yet far off. 

4. Determination of how much progress any particular group 
assigned to any classroom teacher ought to make. 

The scheme for rendering standards fairly intelligible, which 
was finally decided upon as the only feasible one for Republic, 
was this: 

1. All items on the rating card were defined in general terms, 
with reference to the dictionary. 
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2. Items were redefined in terms of the standards thought 
to be desirable in education. 

3. As] many concrete acts and conditions of teachers, teaching, 
pupils, schoolrooms, etc., as could be collected by the superin- 
tendent and the cooperating teachers were typewritten and made 
available for use in supervision. This material grew rapidly 
from a few pages to more than a himdred. 

The seven elements or standards by which teachers were to 
be rated were mimeographed on separate slips of paper and dis- 
tributed, with appropriate explanations and directions to those 
taking part in the experiment. 

STANDARDS 

I. Thinking 
General definition: Mental activity in the course of which the mind 
locates a difficulty, and in the process of solving the difficulty arrives at a 
conclusion which is, to it, a new meaning, belief, act or way of thinking, or 
any combination of these. Definition of standard: Thinking by pupils ii^ 
study or recitation, and test of the quadity and amount agreed upon and 
set down in the course of study or other practice standards. 

n. Emotional Reaction 
General definition: Feelings, and actions growing out of feeh'ngs. Defini- 
tion of standard: Appreciation resulting in immediate pleasure, and emotion 
leading to action which is of individual and social value. 

III. Knowledge and Skill 
General definition: Information and practical efficiency in doing. Defini- 
tion of standard: Classroom practices and results as to knowledge and skill 
as set down in the course of study and other practice standards. (A course of 
study in which standards of procedure and results as to knowledge and skill 
required are not determined by objective measurement of both needs and 
results, in so far as that is possible today, is hardly to be defended.) 

IV. Morale in Despatch op Work 
General definition: Confidence, courage, loyalty, self-reliance, prompt- 
ness, and persistence with which work is performed. Definition of standard: 
Confident, courageous, loyal, self-reliant, prompt, and persistent spirit of 
pupils at work. 

V. Initiative in Socially Significant Situations 
General definition: Ability and will to propose or choose, lay out, and 
carry forward work furthering the purpose of the individual and the group. 
Definition of standard: Pupils proposing or choosing, organizing, and carrying 
forward work furthering the educative purpose of school groups. 

VI. Ethical Selp-Control in Situations Socially Significant 
General definition: Inhibition of actions which would interfere with 
carrying forward the purposes of social groups. Definition of standard: 
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Inhibition in the classroom, and other group-units of the school, of conduct 
interfering with carrying forward educative activity. 

VII. Deportment 
General definition: The manner, bearing, or style of a person in doing 
things. Definition of standard: Easy, natural, graceful, and courteous use of 
correct form in doing things. 

INSTRUCTIONS ACCOMPANYING THE STANDARDS 

Thinking Straight 
All of you who arrange these standards want to express your best judg- 
ment of the relative values of the standards. In order to do this, avoid 
thinking of the time order in which you may have been taught to believe these 
standards are acquired by boys and girls. Think rather of the concrete 
acts making up each standard as being considerably different at different 
ages. More concretely, think of the group of boys and girls you teach as 
possessed, and not possessed, alternately, of the attitudes, abilities, and 
habits implied in each standard, and ask yourself: "In what order of impor- 
tance would I place the possession of these standards by my boys and girls? 
How would I emphasize their acquisition by the pupils under my charge if I 
felt a deep responsibility to each individual in my group, and to society as a 
whole, and knew my efforts this year were to be the last conscious educative 
efforts to be expended on a majority of these boys and girls for the rest of 
their lives?" But do not rate any proposed standard low because you do not 
now know how to get pupils to acquire it. Rate the standard according 
to its importance or desirability, and face squarely the issue of finding new 
subject-matter or methods by which the standard may be realized. In this 
concrete fashion, test and re-test your arrangement of the standards. 
Final Directions for Arranging the Standards 

1. Read the seven standards critically, trying to evaluate them. 

2. Spread the standards out before you so that you can get what they 
contain in perspective. 

3. Arrange the slips on which standards are printed in the order of the 
importance of the standards in the results of teaching, beginning with the 
most important. 

4. If, in your judgment, the least important standard is so low as to 
approach zero, mark it zero. 

5. Pin slips together in the order in which you rank the standards and 
return them in that order. 

One hundred and thirty-two persons, all of whom were engaged 
in school work, assisted in the study by arranging these standards. 
Fifty of the judges worked under the personal direction of the 
author, and 45 others under the direction of one or another of 
the first fifty. The remainder of the judges received the material 
by mail. Seven of the replies were rejected because it was ap- 
parent that the persons making them had not followed directions. 
The returns from 125 judges were tabulated. 
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A few less than a hundred judges may be grouped into four 
divisions as follows: A group of graduate students in a certain 
university, a group of local teachers, a group of teachers and 
teachers-in-training in a dty normal school, and a group made up 
of elementary and junior high-school teachers working under one 
principal in a large dty. The remainder of the judgments were 
made by prindpals and superintendents in various Michigan 
towns and dties. 

The data derived from the 125 judgments are as follows: 

TABLE I. FREQUENCY WITH WHICH EACH RANK 

WAS GIVEN EACH ITEM 



Item No.* 


Rank* 







1 


2 


3 


4 


5 


6 


7 


I 










11 
23 
19 
29 
28 
12 
3 


7 

23 
31 
28 
24 
4 
7 


28 
35 
23 
16 
12 
12 


79 


m 




9 

3 

6 

12 

18 

76 


9 
12 
10 
23 
43 
29 


13 
23 
27 
20 
32 
9 


13 


V 




14 


IV 




9 


n 




6 


VI 




4 


vn 


1 











* The higher the rank, the larger the number indicating the rank. Items of such 
small value as to be insignificant, in the opinion of the judges, are scored 0. 
' The number of items in the original material are preserved for reference. 

Table I should be read as follows: Seventy-nme judges thought 
Item No. I most important, 28 thought it second in importance, 
seven thought it third in importance, and eleven thought it fourth 
in importance. None thought it less than fourth in importance. 

The returns for the different groups have also been tabulated 
separately. From these tabulations the following facts appear: 

1. The order of importance of the items is the same in the 
case of each of the groups of judges. 

2. The general form of each distribution for each item is the 
same for each of the groups of judges. 

3. The judges who worked \mder the personal direction of the 
author recognized the real differences in relative position as 
established by the whole group a little more frequently than did 
the judges to whom the material was sent by mail. 
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It is probably safe to conclude, therefore, that the items do in 
reality stand in the order of importance here assigned. On the 
other hand, the importance of this order may be great or small 
according as the absolute value assigned to the least important 
item in the list is great or small. 

From Table I, the values of the various items in terms of prob- 
able error imits have been determined and corrected into point 
scales of 100 and 1,000 points. 





TABLE n. TTTR VALUES OF 


THE ITEMS 








Percent Each 


Adjusted Points 


Value of 


Cumulative or 
Total Values 


Value Is of 
Total Value 






Intervals 


Basis of 


Basis of 








100 


1000 


0-Vn 3.0 


Vn 3.0 


7.37 


7 


75 


vn-vi 1.6 


VI 4.6 


11.30 


11 


115 


vi-n 1.0 


n 5.6 


13.76 


13 


135 


n-iv 0.3 


IV 5.9 


14.50 


14 


145 


IV-V 0.4 


V 6.3 


15.48 


16 


155 


v-m 0.2 


in 6.5 


15.97 


17 


160 


m-i 2.3 


I 8.8 


21.62 


22 


215 


Totals 8.8 


40.7 


100.00 


100 


1,000 



The value of the various items varies according to the value 
assigned the least important item in the list. For example, if 
Item No. VII were zero, as one judge would have it, Item No. I 
would be 5.8 units, or three and six- tenths times the value of 
Item No. VI, imder the same condition. Whereas, under the 
value assigned to Item No. VII, Item No. I is only one and nine- 
tenths times the value of Item No. VI. On the other hand, if 
Item No. VII were assigned a value of 5.0 units. Item No. I would 
be only about two times the value of Item No. VII; whereas, 
under the value now assigned to Item No. VII, Item No. I is 
three times as important as Item No. VII. Without going any 
further into the need for, and difficulties involved in, trying to 
fix a value for one of the items with reference to zero, it may be 
said that three units were adopted as the value of the least impor- 
tant item, mainly, because the author was in constant contact 
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with a number of judges who were willing, for the most part, to 
allow a value that high for the item in question, but were unwilling 
that the value should be placed any higher. The reason, then, 
for assigning a value of three units to Item No. VII, department, 
was a practical one rather than a scientific one. 

The rating scheme which follows is based upon the values 
given in Table II. 

FIGURE 2. TENTATIVE PLAN FOR RATING A TEACHER ON THE 

PROGRESS SHOWN BY PUPILS 



Teacher- 



Experience 
Grade 



.Training. 



Subject 



Date. 



Rough estimate of General Mekit: A B C D E (Circle thus: ®) 
Analysis of results or progress by observation, examination, or application of 
standardized tests or scales, or by two or more of these methods: 



General Merit 


E 


D 


C 


B 


A 






T. Deportment 


12 


2 

23 

234 

234 

2345 

2345 

3456 


345 
45678 
56789 

5 6 7 8 9 10 

6 7 8 9 10 11 
6 7 8 9 10 11 12 

7 89 10 11 12 13 14 15 16 


6 
9 10 

10 11 12 

11 12 13 

12 13 14 15 

13 14 15 16 
17 18 19 20 


7 


n. Ethical self-control 

in. Emotional reaction 

IV. Morale 


11 
13 
14 


V. Initiative 


16 


VI. Knowledge and skill. . . 

Vn Thinkinor 


17 
21 22 







Sunmiary: Numerical scoreL 



Equivalent: A B C D E (Circle thusO) 



Explanation: Numbers for each item in the groups A, B, C, D, and £ give the 
following approximately correct numerical values for each group: A (superior) 93-100; 
B (above average) 72-92; C (average) 30-71; D (below average) 9-29; E (inferior) 0-8. 

Suggestions for Iicprovement: 

(Criticisms interpreting the rating given usually cover several type- 
written pages, and contain references to the list of ''concrete acts" appearing 
below, results of standard tests given to pupils, and the principles of educa- 
tion as expressed in standard books on education and psychology. A brief 
summary of this material appears here. Copies are kept for reference and 
comparison.) 
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While still working with the typical mixed rating scheme pre- 
pared as the result of the first cooperative patchwork on rating 
plans, considerable progress was made in collecting concrete 
examples of each standard proposed. Enough was done to make 
it clear that the bulk of such material, if collected, would be 
enormous. While work was progressing on the evaluation of the 
seven general headings, some attempt was made to choose applica- 
ble material from the earlier study and restate it a ^ a list of con- 
crete acts, which, if observed in pupils, would be some evidence 
that the standards under which they were classified were being 
acquired. To this material were added statements concerning 
the standard tests and scales in use or proposed for use in Republic 
schools. Lastly, teachers contributed an enormous amount of 
material so detailed that it was thought necessary for present 
purposes to have a committee classify, arrange, and condense 
it into the limits of seven mimeographed pages. 

The list of concrete acts which follows represents a condensed 
statement of the supporting material used with the proposed 
scheme for rating teachers on the basis of the results of their 
teaching. Any teacher, pupil, or supervisory oflScer, attempting 
to use this material will of necessity choose only those items 
applicable to the case in hand. Many teachers have prepared 
for themselves much more complete and detailed examples under 
each standard, but they fall under some of the headings given. 

CONCRETE ACTS 

Standard I. Thinking 

1. Attains standard score for his grade in 

a. Stone's Reasoning Tests (grades 3-8) 

b. Composition (grades 4-12) 

c. Trabue Language Scale (grades 2-12) 

d. Thorndike's Visual Vocabulary Scales (grades 3-12) 

e. Thorndike's Scale Alpha 2 for Measuring the Understanding of 

Sentences (grades 3-12) 

f. Starch's Physics Test 

g. Henmon's Latin Tests, etc, 

2. Attains normal school grades in 

a. School tests over minimum essentials in arithmetic 

b. Teacher's or superintendent's test in other subjects 

c. School tests in grammar (grades 5-8). 

3. Expresses himself clearly in his own words. 

4. Exhibits ready ability in reproducing in recitations the thinlg'ng that has 

been done before in mastering past work. 
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5. Interprets intelligently any complex directions for work. 

6. Clashes and arranges material well. 

7. Defines accurately, though sometimes awkwardly. (In the kindergarten 

by pointing and gesturing.) 

8. Locates and defines difficulties in material suitable for his grade. 

9. Proposes solutions to problems cautiously and tries them, selecting 

and rejecting material intelligently. 

10. Reaches tentative conclusions and holds them tentatively while searching 

for more evidence. 

11. Verifies conclusions carefully before considering them final. 

12. Considers the bearings of conclusions carefully. 

13. Accepts the true bearings of conclusions when they are pointed out. 

14. Evaluates problems as well as the material used in the solution of prob- 

lems. 

15. Decides correctly when to depend on his own resources and when to seek 

help. 

Standaso II. Knowledge and Skill 

1. Attains standard scores for his grade in 

a. Courtis Standard Research Tests, Series B, in fimdamentals of 

arithmetic (grades 4-8) 

b. Woody's Arithmetic Scales (grades 2-8) 

c. School tests in minimum essentials in arithmetic (grades 3-8) 

d. School tests in minimum essentials in grammar (grades 5-8) 

e. Spelling words from A3n'es Spelling Scale concealed in sentences 

f. Composition, technic (grades 2-12) 

g. Copying familiar material (rate and quality) A3n'es Handwriting 

Scale "Gettysburg Edition" 
h. Stone's Reasoning Tests (grades 3-8) 
i. Trabue's Language Scale (grades 2-12) 
j. Starch's Physics Test 

k. Thomdike's Visual Vocabulary Scale (grades 3-12) 
1. Thomdike's Scale Alpha 2 for Measuring the Understanding of 

Sentences (grades 3-12) 
m. Henmon's Latin Tests 
n. Rugg and Clark's Standardized Tests in First- Year Algebra 

2. Attains normal grades on teacher's and superintendent's tests in subjects 

not covered by standard tests. 

3. Exhibits daily in the recitation a ready knowledge of facts and skill in 

fundamental processes of the subject in hand. 
Note: Whatever value is assigned to items 2 and 3 should be appor- 
tioned about equally among the subjects for which the teacher is 
responsible, and for which satisfactory standard tests have not yet 
been devised. 

Standard III. Initiative in Socially Signipicant Situations 

1. Asks questions worth while for the whole group to answer. 

2. Proposes problems essential to the progress of the group in the subject at 

hand. 
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2. Is cliecrfixL and agreeable vben be cauiol have his o«b «m j. 

3. Moves to aad from dasses azid aboot ka&s in a |HumH and ordcriy 

manner. 

4. Is loyal to teacfaezs and the vork they assigiL 

5. Is loyal to school omoers and the rules they make and cntece. 

6. Is loyal to the school and its uidcxtakin^ 

7. Obeys all ordinary requests promptly and cheerfully, and in spirit as wA 

as \eiVa. 

8. Docs not talk back or sulk when corrected. 

9. Docs not fret or worry over sdiool tasks, but seeks to understand them 

and does his best dieerfnlly. 

10. Docs not cry, whine, or tattle over little things. 

11. Is not discouraged by defeat or failure. 

12. Docs hard or otherwise disagreeable work without expectation of praise. 

13. Works in the confidence that he and his dassmatcs can do what other 

boys and giris have done and are doing, and a little more. 

14. Relies upon his own efforts in prq>aring a lesson. 

15. Undertakes with courage work he knows to be di£Bcult. 

16. Finishes assigned lessons even if he is compelled to q>end won time on 

them than some of his brighter Hassmates, 

17. Begins work promptly and plunges into the heart of it. 

18. Faces duties and responsibilities squarely — does not "sdcstcp" or '*pass 

the buck." 

19. Does not hunt for and elect supposed "sn^ courses." 
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20. Is conscious of some of the important habits which go to make up a 
worthy character, and strives to act so that these habits will be formed. 
Standaso V. Emotional Reaction 

1. Appreciates standards of achievement in school subjects and wants to 

attain them. 

2. Appreciates standards of achievement in school subjects and wants his 

class and his school to attain them. 

3. Takes pride, but not foolish pride, in his class, school, city, state, or nation. 

4. Takes pride in superior workmanship, and will not do slipshod work. 

5. Takes pride in the character of his associates and chooses them so that 

he will not be ashamed of them. 

6. Takes pride in cleanliness of person, schoolroom, premises, and streets. 

7. Wants to serve his class, school, town, state, and nation. 

8. Enjoys good music, literature, and art. 

9. Likes innocent fun on every proper occasion. 

10. Enjoys school exercises: — rhythm, siory-games, free games, etc. 

11. Gets a true emotional reaction out of insight into external truth either 

in science or in religion and morals. 

12. Feeb and expresses reverence for ties of friendship, family, and religion. 

13. Does any desirable act because he wants to be helpful, and refrains from 

imdesirable acts because he dislikes them. 

14. Appreciates kindly motives in others and gets satisfaction out of express- 

ing his appreciation. 

15. Values the personality of others and his own as well. 

16. In the classroom acts of service are popular. 

Standard VI. Ethical Self-Control in Situations Socially 

Significant 

1. Obeys requests promptly and cheerfully. 

2. Obeys the rules of the school. 

3. Enters the room and leaves the room quietly and inconspicuously, 

especially during school hours. 

4. Avoids coughing or spitting in public. 

5. Does not intrude on another person's privacy or take his time imjustly. 

6. Does not "delay the game." 

7. Tells the truth without evasion. 

8. Borrows little and returns borrowed articles promptly and in good 

condition. 

9. Does not steal or even borrow without permission. 

10. Keeps appointments. 

11. Keeps promises made, and avoids rash promises. 

12. Does not copy work or seek unfair help from others. 

13. Will not permit copying or give unfair help to others. 

14. Does not "bluff" in the recitation. 

15. Does not bribe, trade, blackmail (threaten to tell) or use any other undue 

influence to have his own way in athletics or other school affairs. 

16. Controls temper and avoids quarrels. 

17. Does not allow himself to be bribed, intimidated, or influenced unduly in 

any way in school affairs. 
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18. Does not tattle, but will not allow the interests of the sdiool to suffer or 

injustice to be done because of lack of information he could supfdy. 

19. Does not tease or bully weaker persons nor allow others to do so without 

protest. 

20. Cooperates in protecting school buildings, premises, and streets horn. 

litter such as fruit skins, pstptr, and marking. 

Standard VIL Deportment 

1. Sits well back in seat leaning forward from his hips, feet on floor, head 

erect, and forearms resting easily on desk when writing or working at 
desk. 

2. Rises easily from seat, stands erect on both feet, free from desk, in 

reciting and sits again easily. 

3. Walks or runs lightly in moving about classrooms and halls. 

4. Speaks and reads clearly and distinctly so that every person in the room 

may hear. 

5. Holds book or paper in correct position when reading orally. 

6. Passes and collects materials quietly and easily. 

7. Takes out and puts away work quickly, quietly, and neatly. 

8. Puts on and takes off wraps quickly and quietly. 

9. Does not stop work to stare at visitors. 

10. Is courteous: 

a. Is unassuming. 

b. Avoids abrupt speech and coarse manners. 

c. Laughs and talks quietly. 

d. Does not rush or crowd in halls. 

e. Allows others to enter doors ahead of him. 

f . Keeps to the right. 

g. Avoids passing between persons in conversation or in front of anyone. 
h. Grants a favor or acknowledges one easily. 

1 1 . Does not put pencils or pen in the mouth, or fingers in mouth or nose. 

12. Dresses neatly and is dean. 

13. Keeps working materials in order on desk, and at the board. 

14. Turns in neat work. 

15. Responds, when addressed, pleasantly and in good form, answering 

questions, "Yes, Miss "; "No, Miss "; or giving 

information in clear sentences. 

A careful reading of the above list of concrete acts will reveal 
that the means at hand for making scientific observations of the 
progress of pupils are scanty. It is still necessary, if one wishes 
to know whether pupils are making progress in forming most of 
the desirable habits and attitudes which they ought to form as 
the result of their school experience, to watch them at work and 
play in all the situations for which the school is responsible. Con- 
sequently, it would be fooUsh to assert that the most careful 
observer can detect more than the general trend of habit and 
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attitude formation outside of the limited field now occupied by 
the scales and tests. This is one of the strong points made by 
teachers against the author's use of the rating scheme in rating 
their work. 

It does not seem at all impossible, however, that, should we 
develop means of measuring progress in habit and attitude forma- 
tion along the lines indicated in the concrete acts proposed above, 
we would soon develop a technic of producing the desired results 
in boys and girls with a great deal more certainty, ease, and 
rapidity than we now have reason to believe we shall develop it 
in the next fifty years. At least the lists above furnish the basis 
for further experimental work. 

The facts in regard to the actual ratings given teachers from 
1916 to 1919 are shown in Tables III, IV, and V. 

If the marks given below represent the facts, the first semester 
the rating scheme was in use the median teacher in Republic was 
a low-average teacher. The second semester, an average teacher; 
the third semester, an average teacher; the fourth semester, a 
high-average teacher; the fifth semester, an above-average teacher; 
and the sixth semester, an above-average teacher. Reference to 
the rating scheme above would indicate that the gain was from a 
median teacher of ability 35 to a median teacher of ability 80. 
In other words, in the judgment of the superintendent, the 
efficiency of the average teacher in Republic schools as a result- 
getter mare than doubled in the three years imder discussion, and 
this in spite of the fact that the above-average teachers were 
being drawn off by schools which paid better salaries at least as 
fast as the superintendent was able to improve or eliminate the 
teacher of below-average ability. The explanation can be found 
only in the fact that, with better salaries, and dearer notions of 
what good teaching really meant, the superintendent was enabled 
to recruit from other cities and from normal schools and colleges 
a higher grade of teacher material than ever before. For example, 
20 percent of the teachers now employed in Republic achieved 
honors for scholarship in normal school or college. Some others 
were recommended as the best students in special departments. 
However, this does not discredit the value of the rating scheme 
as a supervisory device for the superintendent proved able to 
develop teachers while in service. Thirty-seven percent of the 
teachers who have been employed for a semester or more in 
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TABLE m. RATING OF INDIVIDUAL TEACHERS — 

SIX SEMESTERS, 1916-1919 

REPUBLIC TOWNSHIP SCHOOLS, REPUBLIC, MICHIGAN 





1916-17 


1917-18 


1918-19 


RfSLsofi for 


Tacber 


ut 


^ Ind 


ut 


^ 2nd 


^ ut 


^ Ind 


Withdrawal 


1 
2 
3 

4 


C 
C 
B 
C 
D 
C 
C 
B 
E 
C 
D 
D 
D 
B 
E 
B 
C 
C 
C 
C 
C 


D 
C 

B 
C 
D 
C 
C 
B 
D 
B 
D 
C 
D 
B 


D 
C 
B 
C 
C 
C 
D 


D 
C 
B 
B 
C 
C 


C 
C 
A 


B 
C 
A 


Request of supt. 
Pronx>ti(Hi 


5 
6 
7 


B 
C 


B 
C 


Request of supt. 
Request of supt. 
Poor health 


8 








9 
10 


C 


C 


C 


B 


Request of supt. 
Promotion 


11 


E 








Request of supt. 
Pissatisfiirtion 


12 








13 










Dissatisfaction 


14 
15 


B 


B 


B 


B 


Retirement 
Marriage 

Marriage 
Promotion 


16 
17 


B 
C 


B 


B 


A 


A 


18 










19 
20 


C 
C 


C 


C 


C 


C 


Promotion 


21 










Death in family 


22 


C 
B 
C 


D 


£ 






Request of supt. 
Promotion 


23 






24 


B 
B 
E 
C 
B 
C 
C 
C 


B 
B 
D 
B 
B 
B 
B 
C 
C 
D 






Promotion 


25 


B 
B 
B 
B 
C 
B 


B 
B 
B 

B 
B 




26 








27 








28 






Poor health 


29 








30 








31 






Promotion 


32 










Promotion 


33 








B 


B 
B 
D 
B 
B 
B 




34 










35 










D 
B 
B 
B 




36 












37 












38 










Death 



A blank in the column "reason for withdrawal" means that the teacher 
Is still in service in Republic schoob. 

'Promotion" means taken by some other dty at a higher salary. 
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TABLE IV. DISTRIBUTION OF MARKS GIVEN TO TEACHERS, 

BY SEMESTERS, 1916-1919 
REPUBLIC TOWNSHIP SCHOOLS, REPUBLIC, MICHIGAN 





1916-17 


1917-18 


1918-19 




Mark 


1st 


2nd 


1st 


2nd 


Ist 


2nd 


Total 




Semester 


Semester 


Semester 


Semester 


Semester 


Semester 




A 










2 
11 


2 
14 


4 


B 


4 


6 


6 


10 


51 


C 


11 


10 


10 


7 


7 


3 


48 


D 


4 


5 


3 


3 


1 


1 


17 


E 


2 




2 


1 






5 












Total 


21 


21 


21 


21 


21 


20 


125 



TABLE V. 



DISTRIBUTION OF LAST MARKS GIVEN TO TEACHERS 
WITHDRAWING FROM REPUBLIC SCHOOLS 



Marx 


Reason for Withdrawal 


Totals 




Required 


Promotion 


Other Reasons 




A 










B 
C 
D 


1 
3 
2 
2 


5 
4 


3 
2 


9 
9 
2 


E 




1 


3 








Total 


8 


9 


6 


23 



Republic schools during the last three years have shown enough 
improvement to cross the boimdary between a lower and a higher 
rank. Fifty-three percent of the teachers now in Republic schools 
have improved at least one division. In other words, supervision, 
as it foimd expression in suggestions for improvement in the items 
of the rating scheme, was about equally responsible with elimina- 
tion of the less capable and the employment in their places of the 
more capable type of teacher, for whatever improvement has 
taken place in the efficiency of the teaching corps. 

Of course, the question of the accuracy of the ratings of the 
teachers is an important one. The study has the Umits imposed 
by the fact that one judge, and only one, rated the work of one 
group of teachers, and only one. On the other hand, the methods 
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schools. Hfnrr, if scxioos error has been made, it 
made wben the ffafhm of RepobSc rae lated for the first 
time in Janoaiy, 1917. 

Theafasohite antfaodtj placed in the banck of the snpenntciid- 
cot to tUmmtt trarhrr^ had so mnch to do with whatever sac* 
ct» altffidfd the use of the payment-f or-ment plan, that it would 
be focriish to rrroirrmmd the pJan for geoenl adoptkxi where the 
anthmty mentioned docs not exist. The reasons for wfaicji 
teachers could be dtsmtssrd were as foDows: 

U Low eBBdcDcyy withont, in the judgment oi the superintend- 
tnty prc05ptct oi improvement in the immediate fatnre. 

2. Acts injnrioos to the interests of the scho<J ch* thecommnnity, 
repeated after warning by the supeiintendenL 

Republic, Hke every other community in the land, has its school 
politicians. These men and women study constantly evoy 
feature of school administration, supervision, and teadungy not 
for the sake of providing better school facilities for boys and girls, 
but for the sake of gaining personal advantage from any phase of 
school work which can be put in the wrong light before the public. 
These persons do not have to be reasonable or consistent in order 
to be troublesome. Soon after the bonuses were made large 
enough to attract their attention, they began to demand that the 
amount of the additional compensation should be saved to the 
public. They contended that a teacher would teach a year for 
the basal salary just as willingly and just as efficiently as she wBuld 
for the basal salary jdus the bonus. They contended further that 
the teacher who was not that sort of an idealist was not fit to 
teach boys and girls anyhow. Even if the scheme could have been 
defended successfully from attacks from without, it would still 
have been in the way when it came to employing new teachers; 
for the teachers desired could hardly have been employed even for 
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a sum equal to the basal salary and the median bonus ($100 a year) 
combined. It was dearly impossible to secure funds to care for 
the bonuses in addition to the necessary basal salaries. Hence, 
the additional compensation-for-merit scheme was abandoned in 
1919 and the superintendent and most of the teachers breathed 
a sigh of relief. 

The rating scheme proposed above is still in use as a supervisory 
device, but, of course, without any relation to the salary schedule. 
Used in this way, the rating card is a valuable supervisory instru- 
ment. Additional evidence of this fact was obtained as follows : 

Some time following the fifth semi-annual rating the superin- 
tendent was requested to present the results of his inquiry before a 
state meeting of superintendents and school board members. Ac- 
cordingly, the following notice was sent to teachers in the largest 
building in Republic Township: 

I have been asked to present the results of my investigation leading to a 
tentative scheme for rating teachers before the State Association of Super- 
intendents and School Board Members. Before accepting the invitation, I 
should like your candid opinion as to whether your cooperation in forming 
the scheme and in being rated by it has affected your work and how. Record 
your conclusions on this paper without consultation and without signing 
the paper. No effort will be made to hold anyone responsible for adverse 
judgments. Indeed, no effort will be made to discover who wrote which 
paper. However, the opinions may be classified as to the amount of profes- 
sional thought they reveal before they are presented to the Republic teachers 
or any other audience. 

Wm. L. Connok 
SuperitUendefU 

Replies were received in sealed envelopes, shuffled thoroughly 
by a clerical assistant, and typed for the consideration of the 
superintendent. They ranged from replies as favorable as the 
following: 

My opinion of the rating scheme is as follows: 

First, it aids the teacher to measure her pupils, and find their weaknesses, 
thereby giving her a chance to help them overcome their trouble, whereby 
the teacher gets the result required. 

Second, it helps the teacher to measure herself and gives her a chance to 
study the standard by which she is measured. 

Third, following the rating scheme as closely as possible helps my pupils 
to think and helps me to help them. 
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To those as unsatisfactory as the following: 

If my cooperation in forming our rating scheme, and being rated by it, 
has in any way affected my work in the school I am entirely unconsdous of it. 

Of the seventeen replies received, twelve were favorable and five 
adverse or noncommittal. The comments, however, make it 
dear that a great deal of good came out of the work of rating 
teachers. On the other hand, it would be difficult to read through 
the discussions presented without gaining the impression that a 
great deal of misimderstanding and hard feeling existed. Indeed, 
enough soreness is in evidence to have disrupted any administra- 
tion not securely foimded. However, the dissatisfaction was 
directed more against the payment-for-merit plan than against the 
actual operation of the rating scheme as a supervisory device. 

It is safe to say that at least three-fourths of all teachers 
employed in Republic schools were willing to work imder the 
merit plan, and very seldom did the other fourth openly express 
dissatisfaction. How much of this seeming content was due to the 
fact that everybody's salary was going up anyhow (the scheme was 
accompanied by a general rise in wages in no essentail way related 
to it), how much of it was due to the merits of the rating scheme, 
how much to the fact that teachers cooperated in forming the 
plan, and how much to the fact that the superintendent exercised 
rather imusual powers in employing and discharging teachers, it 
would be hard to tell. 

However, if the superintendent of the Republic schools could 
secure a living and saving wage for the least experienced and poor- 
est trained teacher in the corps, together with reasonable increases 
for additional experience and training, up to 75 percent more than 
the minimum wage, he would recommend that the question of 
extra compensation for merit be reopened. 

In the meantime, the rating card proposed above, while imper- 
fect in certain respects, is still in use in supervision, and really 
represents an advance over previous efforts. It is a useful 
supervisory device because it directs attention effectively to im- 
portant elements in the changes which it is a teacher's task to 
produce in children. 



REPRODUCTION AS A MEASURE OF READING ABILITY^ 

Arthur W. Kallom 
Department of Educational Investigation and Measurement, Bostony Massachusetts 

The Importance of Silent Reading 

Reading in some form occupies a large share of the curriculum 
of both lower and upper grades. In the first grade the time is 
ahnost wholly occupied in teaching children how to read; and, 
oral reading predominates. As the child progresses through the 
grades the time devoted to oral reading gradually diminishes and 
the time devoted to silent reading increases. 

These two forms of reading have entirely different aims. Oral 
reading above the primary grades aims to convey the thought to 
some hearer. Correct pronimdation, dear expression, and good 
enundation are, therefore, necessary in the oral work. These, 
however, are only the medianics which enable the reader to con- 
vey the thought which he has in mind with force and imderstand- 
ing. 

In silent reading, on the other hand, the aim is to teach the 
pupil to obtain the thought from the printed page for himself. 
This silent reading is followed by some form of reproduction 
dther at once or at some future lime. Until recently the teacher 
of the upper elementary grades has not felt the importance of 
teaching silent reading. Even now it is very probable that she 
does not realize the full importance of this teaching. Reading, 
oral or silent, means the recognition of the printed word as a sym- 
bol and a correct interpretation of the symbol into a picture for 
which the symbol stands. 

Factors in Silent Reading 

This is not by any means a simple process. It may be analyzed 
into the following factors: 

1. Correct visualization of each word 

2. Knowledge of the various meanings of each word 

3. Choice of the correct meaning as shown by the context 

> An address delivered before the National Association of Directors of Educational 
Research at Cleveland, Ohio, February, 26, 1920. In 'the absence of Mr. Kallom 
the address was presented by Miss Harriet M. Barthelmess. 

359 
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4. Forming of the correct relations between these meanings in 
order to interpret phrases and clauses 

5. Forming of the correct relations between phrases and clauses 
in order to interpret sentences and paragraphs. 

This interpretation of words, phrases, sentences, and paragraphs 
depends on at least two things: (a) the pupil's experience; 
(b) his ability to recall the experience and apply it to the case at 
hand. 

Any inability on the part of the pupil to make application of his 
experiences or the making of a wrong application results in error. 

Two illustrations will make this thought clear. Question 14 of 
Kelly's Kansas Silent Reading Test II reads as follows : 

A list of words is given below. One of them is needed to complete the 
thought in the following sentence: The roads became muddy when the 
snow 

Do not put the missing word in the blank space left in the sentence, but 
put a cross below the word in the list which is next above the word needed in 
the sentence. 

water 

is 

melted 

snow 

This question is one of the most difficult in the entire test, 
being given the value of 4.9. To solve this question correctly the 
pupil must: 

1 . Refrain from filling in the blank with the correct word 

2. Correctly interpret the phrase "below the word in the list" 

3. Correctly interpret the clause "which is next above the word 
needed." 

These three phases must be correctly interpreted not only 
individually but also with relation to each other in order to get the 
correct answer. The high value of 4.9 for this question is proba- 
bly due to the fact that pupils do not see the relation between the 
parts correctly. Pupils do not, as a rule, fail in reading the 
words of this selection nor in knowing the meaning of the individ- 
ual words, for none of them is difficult, but they do fail in under- 
standing the relation between the words, phrases, and clauses. 
The failure to see this relation is often laid at the door of careless- 
ness. This may be a cause at times, but more often a lack of 
experience in meeting such a complicated situation is a contribu- 
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tory cause and at times may be the important cause of the error. 
The pupil has been in the habit of placing a cross before or after 
the word, and when he reads '^put a cross" his experience leads him 
to put a cross before or after the word, thus making an error. 

But pupils also make wrong interpretations of individual words. 
One of the tests given to grade v in May 1919 was the part of the 
story of Aladdin in which the magician directs Aladdin to go to the 
bottom of the stairs into a great imdergroimd building divided 
into three vast halls. In each of these halls Aladdin was to find 
four large brass vessels. A boy who had read this selection inter- 
preted the word ^Vessels" to mean ships. He had a perfect 
picture of this imdergroimd room as some sort of museum in 
which these ships were placed. After some questioning as to what 
other meaning the word "vessels" might have, he remembered the 
meaning of an "um" or "vase." Immediately his whole picture 
was changed. A pupil left to himself, however, does not get a 
chance to have this impression changed. He may, therefore, go 
on for some time on the basis of the wrong interpretation. 

The teacher may learn of this wrong interpretation only through 
some form of reproduction. The great criticism against repro- 
duction has been that it involves memory. What is generally 
meant is word memory without thought or without meaning. 
This should be decried everywhere and at all times. But the 
right kind of reproduction, depending on the right kind of memory 
should be cultivated, for every discussion depends on the ability 
to think correctly. 

Boston's Progress 

In 1915 and 1916 Mrs. Ellor Carlisle Ripley, assistant superin- 
tendent of schools, was placed in charge of the reading throughout 
the schools of Boston. In imdertaking to improve both oral and 
silent reading four plans were used: 

1. Asking principals and teachers to assemble the children in 
the auditorium, having the best readers act as an example to 
others by reading selections before the audience of the other 
pupils 

2. Asking students in the various schools of elocution to read 
selections suitable for children before the entire school in the 
auditorium 
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3. Selecting two or three of the best readers from a number of 
different schools, assembling them at a central school, and having 
them read prepared and unprepared selections before an audience 
of other pupils, parents, and friends 

4. Visiting a large number of rooms to hear the children (espe- 
cially the poorer ones) read in their regular classes. 

In conjunction with the third phase of this work, viz., when 
selected children had gathered from a number of schools in one 
auditorium, the Department of Educational Investigation and 
Measurement used the Kelly Silent Reading Test. One hundred 
and eighteen of these selected children were tested in all. They 
came from all grades, a few even as low as the fourth, although 
principals- were encouraged to send upper rather than lower grade 
children. The results showed that these pupils had a large range 
of individual differences. There was a great deal of overlapping 
but the medians were from two to eight points higher than the 
standards set by Professor Kelly. 

Selection of Materl\l for Suitable Testing 

As a result of having the Kelly test given to this small group of 
selected pupils, many of the teachers felt that reading ability was 
not being tested. They, therefore, wished a further test to be 
made with selections more nearly like the ordinary reading of 
pupils. As a result of this, in the fall of 1916 a committee of 
teachers representing grades iv to vni inclusive, met for the 
purpose of selecting suitable paragraphs for testing grades iv, v, 
VI, VII, and vni. The following directions were given for guid- 
ing the teachers in making their selections: 

1. That the paragraph selected should be from 100 to ISO words 
in length 

2. That the paragraph should as far as possible tell a complete 
story 

3. That the teachers should select paragraphs suitable for their 
own grades 

4. That paragraphs selected should not be familiar to the 
children. 

As a result of the work of this committee, the department 
received for each grade four or five selections which the teacher of 
that grade thought were suitable. The members of the depart- 
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ment undertook to make from this collection of material a selec- 
tion of two paragraphs for each grade, which would eventually be 
used for testing. Each of these paragraphs was given to approx- 
imately five himdred children. That is, a paragraph selected for 
grade iv by a fourth-grade teacher was given to grade iv, a 
paragraph selected for grade v was given to grade v, and so on. 
In no case was the paragraph selected for a given grade given to 
any other grade. 

Giving and Scoring the Tests 

The tests were given by a group of normal school seniors who 
had been trained to give them in a uniform manner. The pupil 
was given a sheet on which was printed the selection to be read. 
After this selection had been read once, and the time of reading 
recorded in seconds, it was collected and a four-page folder given 
to each pupil upon which he was asked to write a reproduction of 
the paragraph. After this reproduction was written, he was 
asked to turn to the last page of the folder and answer some 
questions based on the paragraph which had just been read. In 
other words, the pupil was required to do four things: 

1 . To read the selection once 

2. To record the time 

3. To reproduce on another sheet all that he could remember 

4. To write from memory answers to questions based on the 
paragraph. 

The scoring of the reproduction was based on the number of 
ideas reproduced. What constituted each particular idea was 
decided upon previous to the correction of the test. In correcting 
the material it was very difficult at times to determine whether the 
idea had been reproduced by the pupil or not. In many other 
instances it was perfectly clear that the pupil, instead of repro- 
ducing the paragraph which he had just read, brought into the 
reproduction many ideas based upon his experience. 

In correcting the reproduction wrong spelling was not consid- 
ered as an error. How much the inability to spell a word inter- 
feres with the ability to reproduce is not known. 
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Retckxs FSOM (^tAI« IV 

The foDoviiig was CHie of the stories gjnnen the foordi grade to 
read and reproduce: 

Eaziy ooe moroing WasfamgtoQ left his quarters and vent aloae to see 
for him<rff wli^ his soAdkrs vere doing in a camp which he had ocdered to be 
fortihed. The wealher vas so cold that he vorr a kxig overGoat vith a great 
cape. The coat c ove re d his uniform, and his hat and cape did not leai^e mnch 
of his face to be seen. For this reason the soldiers who saw him did not 
know that the tall man passing by was their gcnenl, Geoq^ Washington. 



The f oDowing reproductkHis of the f o rgo in g stcvy ilhistrate 
how piqHls weave into their r^rodacticm extraneous ideas which 
have come to them throng their experience. 

When Georges Washington was a boy he told a fie when grew iq> to a 
Gengral no one didn't no him he had a uniform on him and a cape and a cap. 

Early one morning Goeoge Washtongton went oat and saw Abraham 
Uno^ in the window and said to him do yon no me yes I do no yon George 

Washtongton. 

In the first instance the pupil retains the ideas of ''George 
Washington," "a general," "uniform," "cape," and "cap." In 
addition he has added the ideas of 'Sv^hen he was a boy he told a 
lie." In the second reproduction the only thing which was retained 
was that the story was about George Washington. Bringing 
in an idea, such as that of Lincoln, which has nothing to do with 
the situation is an interesting but not imcommon occurrence. 

Attention has been called to the fact that one source of error is a 
misinterpretation of the meaning of individual words. The two 
following reproductions of the same story show the misinterpreta- 
tion of the word "quarters": 

One morning Washington left his quarters on the table and went to see 
how his solderes were dewing. 

Once Goerge Washington said he would go out to see what hb quarters 
where doing in the camp. It was cold so he had to put on his big warm coat. 
He saw what his doildiers were doing. He said let us go out to camp. 

The first pupil shows that of the different meanings of the word 
"quarters" he has selected the wrong one. He may have done 
this either through ignorance or through making a wrong applica- 
tion of his experience due to failure to remember the relation 
between the phrases in the selection given. The second pupil 
evidently has a very hazy idea of the meaning of this word and 
possibly no correct meaning for it. 
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Returns from Grade VI 

Below is given one of the selections given in graxie vx under the 
same conditions and directions as used in grade rv. 

The baby seals make us think of young dogs and they play together like 
puppies. The mother's call to her little ones is similar to that of a sheep, 
and her babies' cry is like the bleating of a lamb. When they are about six 
weeks old they go into shallow pools and learn to swim. As they grow stronger 
they roll down into the sea and take excursions of miles. The seab are so 
valuable that men are allowed to kill only a few of them each year. They 
are not hard to catch. The seal hunters carry clubs about seven feet long 
and as thick as a baseball bat. They stim the animals by striking them on 
the skull and then other men come along with sharp knives and kill them. 

The following is a reproduction written by an eleven-year-old 
girl: 

The baby seals resemble our dogs and puppies. There mother's cry 
sounds like a sheep. When they are old they are put in a tank to learn to 
swim. When they are older they toss balls in a circus. 

This reproduction indicates the importance of previous ex- 
perience. Such a piece of work is often discarded by the 
teacher as useless. As a matter of fact it is a valuable means of 
determining what should be done for the pupil. The question to 
be answered is: "Why does the pupil bring in the ideas about 
the tank and the drcus?" It is Uie answer to this "Why" that 
should guide the teacher in her future corrective work with the 
pupil. 

Questions 

As noted above, a second part of the test consisted of a number 
of questions based on the selection read. The first question for 
the fourth grade, with the answers which the department deemed 
acceptable and those which it deemed non-acceptable, is given 
below. Each of the non-acceptable answers was given by one or 
more pupils. In all, 42 percent answered the question correctly. 

"Why did Washington leave his quarters?" 

Acceptable Not Acceptable 

to see his soldiers because of his trail, to see a man, to go on 

to see soldiers in an errand, on important business, it was 

camp cold, he was a general, he did not want to 

to see his men take it with him, he didn't want to be in 

to see his army. there, he had too much^ they would not 
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know him, he died, he did not like it, his 
mother died, to look ait himsdf , to see what 
they were doing, because he had to, the 
quarters are American money, he left it in his 
pocket, because he wanted to, because they 
told hcs, to go to fi^t the Gennans, to go to 
a^eef. 
Three types of answers are to be noted among the non-accept- 
abk: 

1. Those which 2q)parently come from another part of the story 

lUustraium: because it was odd 

because he was a general 

2. Those which apparently result from a fa3ure to use the ri^t 
meaning of a word 

lUustradon: the quarters are American money 

he left it in his pocket 

3. Those which apparently have nothing to do with the story 
but are based on outside experience 

lUustratum: because his mother died 

because they told lies 
to go to fight the Germans. 

From the returns as a whole it was plain that the paragraph was 
too difficult for fourth-grade pupils to read and get the thought. 
Only 5 percent answered correctly the question **What had Wash- 
ington ordered done?" Neither was this idea included generally 
by the pupils in their reproduction. 

In answering the questions on the story about the seals the 
sixth-grade pupQs showed the same tendency to draw on their 
experience as was exhibited by the fourth-grade pupils. At one 
of the parks in Boston there is an aquarium where there are a 
nimiber of seals. The familiarity of children of the dty with this 
aquarium was shown by the pupils of the sixth grade in their 
reproductions, and particularly in their answers to the fourth 
question: "Where do they learn to swim?" when they wrote "at 
Marine Park." 

Below are given the different answers to the first two questions 
of this selection — answers which seem to indicate again that the 
pupil draws largely on his experience to answer questions. If the 
experience suggested by the reading is more vivid than the mind 
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picture he gets from correctly interpreting the selection read, 
he tends to tell the story of that experience. 

"What do baby seals look like?" 
Acceptable Not Acceptable 

dogs snails, beavers, bears, long and narrow, head 

puppies. of a rat and tail of a fish, fox, face like a rat 

and tail like a fish,' gold, like tadpoles, base- 
ball bat, crabs, like big ones, bat, smooth soft 
skin, dark fur, cat, fish, very small, mice, 
monkey, lamb, long fur with spots for eyes, 
little cubs, Eskimos, tiger, hunter, dragon, 
walrus without tusks. 
"What does the yoimg seals' cry soimd like?" 
lamb dog, cat, baby, loud cry, bird's cry, cow, lion, 

bleating o sheep, horn, bear, screech, deer, whistle, horse, dog 

when he watches, very big, like a ten-cent horn, 

saw, winds, like a wake, groan, elephant, 

ma ma, goat, sweet, squeaky, hoarse voice, 

harsh, very loud noise, echo, walrus, shriek, 

wolf, girl, when you sleep, whales, winds. 

The first question was answered correctly by 70 percent of the 

group and the second by only 56 percent. Many answers show 

that pupils did not even approximate the correct answer and yet 

the answer shows an intimate knowledge of the seal as an aiumal 

at the aquarium. One who is familiar with the seal would not find 

it difiEicult to make most of the descriptions fit. 

Summary 

One of the purposes of a standard test is to give the teacher in- 
formation concerning her class and its individual needs. Al- 
though it is necessary to have reproduction, oral or written, in most 
branches of the curriculum of the upper grades as a means of 
judging whether the pupil has learned the lesson assigned, as a 
basis for standard tests it will probably never be practical. Such 
a test violates two important rules of educational measurement in 
that (a) the test is subjective rather than objective and (b) the 
task of correcting results is prodigious. 

On the other hand, answers to carefully selected questions 
yield as good a measure of pupils' ability to read as does repro- 
duction, and the answers are easier to score. 
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In spite of these objections, however, there are certain advan- 
tages in giving such a test, for it reveals that: 

1. Teachers cannot be depended upon to decide accurately 
whether a selection is difficult or not — This should make teachers 
more lenient in their criticisms of the results of the pupils' study 

2. It is the relation between words, phrases, and sentences 
which makes the difficulty rather than the meanings of the indi- 
vidual words, phrases, and sentences 

3. There will be certain ideas in the selection that very few 
pupils will be able to reproduce — These may be important or not 

4. The pupil will draw very largely upon his experience and not 
be bound down by what he has just read. This gives the teacher 
a due as to how corrective material should be used. 




THE USE OF PSYCHOLOGICAL TESTS IN THE EDUCA- 
TIONAL GXnDANCE OF HIGH-SCHOOL PUPILS 

W. M. Peociok 
Leland Sku^ord Jvmor Uimersity 

In a previous article^ the writer has shown that there is a very 
close rdationship between intelligence level and the elimination 
of pupils from high school. There are good grounds for the pre- 
diction that 75 percent of those who test below average, mentally, 
will fail in more than one-half of their studies during their first year 
of high school; that 50 percent of them will leave school to go to 
work during the first two years; and that none of them will remain 
to graduate. The members of this group demand special atten- 
tion. If they are not carefully guided in the selection of their 
high-school work many of them will fail in all of their subjects 
during the first semester, with elimination as the inevitable result. 

Heretofore we have acted upon the assumption that the only 
way to discover the capabilities of high-school pupils was to per- 
mit them to try themselves out in various subjects of the high- 
school curriculum. It has even been a common practice to 
require all first-year high-school pupils to take an abstract subject 
Uke algebra. Thus many a promising educational bark has gone 
down on the uncharted rocks of the first-year high-school 
subjects. 

Experimentation with psychological tests has now reached a 
stage where we can begin to hope that this wasteful trial and error 
method of procedure is to be discarded for a more scientific plan 
of educational guidance. No tests have yet been devised, either 
mental or pedagogical, which enable the adviser to chart unerr- 
ingly the educational possibilities of a given youth, but we have 
made sufficient progress in the science of mental measurements 
to be able to estimate with approximate accuracy the probable 
school success of a given pupil. The results of a practical experi- 
ment in educational guidance by means of mental tests will be 
described in the following pages. 

^ Proctor, W. M., ''Psychological tests as a means of measuring the probable 
school success of high-school pupils/' Journal of EducaUonal Research, l:25S-70, 
April, 192a 
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riGUKE 1. — ILLUSTaATING DISTHIBUTION OF Sa'PUPHS BY I. Q.'s 
AND CHRONOLOGICAL AGES 
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1. Conditions surrounding Ike experiment. — The mid-year 8A 
class of the Palo Alto Intermediate School compri^ng 31 pupils, 
was examined with the Stanford-Binet Scale in January, 1918. 
Figure 1 shows the distribution of intelligence quotients by chron- 
ological age groups. There were twelve thirteen-year-old pupils, 
eight fourteen-year-old, seven fifteen-year-old, and four sixteen- 
year-old pupils ezanuned. The lowest I. Q. discovered in the 
thirteen-year-old group was 110. All of the thirteen-year-olds 
means "second tuU." 



f 
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were, therefore, accelerated mentally. None of the fourteen-year- 
old group fell below 95 I. Q. They were all at or above age men- 
tally. One fifteen-year-old had an I. Q. of 90 and would be listed 
as "below average" in intelligence. Of the four sixteen-year-old 
pupils, all of whom would be accoimted chronologically retarded, 
three had I. Q.'s of 88, and one an I. Q. of 96. That is to say, one 
of the sixteen-year-olds was normal and three would rate as "dull- 
normal." 

Of the 31 members of the 8A class, 22 entered the Palo Alto 
High School in February, 1918. Four members of the class 
entered secondary schools elsewhere, two entered business colleges, 
two went to work, and one, a girl with an I. Q. of 88, eloped with 
a soldier from a nearby encampment. 

Only four members of this 8A class had earned I. Q.'s below 95. 
One of these, as just indicated, did not enter high school. The 
remaining three entered high school, but two of them dropped out 
before the end of the first year. The percentage of elimination 
from the class of those who tested below 95 I. Q. was therefore 
75.0. The one who remains in high school is making an average 
record in scholarship. She made a rating of "average" on an 
An^y Scale test given a few weeks later, and has shown herself 
capable of diligent application to her school work. 

Each member of the class was questioned as to his or her voca- 
tional ambition, educational plans, and the subjects which he or 
she would like to take up during the first year of high school. 
These data, as well as results attained in Stanford-Binet and 
Army Scale mental tests, were recorded on cards. 

2. Use made of information gathered. — The cooperation of the 
vice-prindpal and entering class adviser was obtained in order 
that the members of the 8A class might receive intelligent educa- 
tional guidance when they entered the high school. Duplicate 
sets of cards were prepared for the use of these persons. On 
registration day all the newly entered 8A graduates were referred 
to the vice-prindpal or the dass adviser for help in making out 
their curriculums. No one was permitted to file a study card 
without this conference. 

Following are samples of the cards used in this experiment in 
educational guidance. The only change from the original is in the 
case of the name. 
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CARD NO. 1 

Smith I Jane Chronological age: 

13 yrs . , 9 mo. 

Score Army Scale. . . 151 Stanford-Binet mental age: 
Army Scale mental age: 16 yrs . , 3 mO • 

17 yrs . , 5 mo . 

Army Scale I. Q 124 Stanford-Binet I. Q 118 

High school subjects which Educational plans: 

pupD desires to take: To finish high 

Sewing school and take 

French business college 

History course. 

Typewriting Vocational ambition: To be 

Piano a stenographer or 

bookkeeper. 

Grade of work done in intermediate and grammar schools: 

"B" and "B+" 

Conunent of Examiner: If assigned tO al- 
gebra can safely be placed in 
first "rapid progress" division. 

Jane Smith was advised to take subjects that would make it 
possible for her to go on to college as well as to carry out her 
ambition to become a stenographer. She took up: English 
German, algebra, and typewriting. During the first semester of 
her high-school course she made an average of ''B" in all of her 
subjects. 

Card No. 2 relates to Mary Jones who took exactly the 
subjects outlined on her card, except that being a first-year 
pupil she was permitted to take four subjects only and had to 
wait until her second year for drawing. At the end of the first 
semester in high school she had earned three ''A'' grades and a 
"B-f-," with an average of 93 percent. 

Here was the case of a girl with very superior ability as indicated 
by two different mental examinations, by her school record and by 
the estimates of her elementary and intermediate school teachers. 
She gave evidence of being an independent thinker, of knowing 
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CARD NO. 2 

Jones , Mary Chronological age: 13 yrs . , 

1 mo. 

Score Army Scale. . . 148 Stanford-Binet mental age: 

17 yrs. , 2 mo. 

Army Scale, mental age: 

17 yrs . , 2 mo . 

Army Scale I. Q 131 Stanford-Binet I. Q 131 

High school subjects which Educational plans: 

pupil deshres to take: To finish high 

English school and attend 
Algebra a university or 
Latin normal school. 

History . Vocational ambition: To 

Drawing become a drawing 

teacher. 

Grade of work done in grammar and intermediate schoob : " A " 
Comment of Examiner: KnOWS JUSt where She 

is going and how to get there. 
May safely be permitted to select 
her own course of study. Assign 
to first division in algebra. 

just what she wanted to make of herself, and just what she would 
have to do by way of preparation. The necessity for educational 
and vocational guidance in her case might well be questioned. 
However, it was a real advantage to her teachers to know at the 
very beginning of her high-school career the quality of her ability 
and something of her life plans in order that they might give 
immediate and sympathetic cooperation. Without this knowl- 
edge they might have made the mistake of holding her back to the 
pace of the "average" pupil. Fortified by the facts relative to her 
mental gifts and vocational ambitions, she is to be permitted to 
complete her high-school course in three years. 

There is just as much danger that the bright pupil will not be 
given enough to do, as that the dull pupil will be given tasks that 
are too diJficult to perform. 
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CARD NO. 3 

Roe , Richard Chronological age: 14 yrs., 

4 mos. 

Score Army Scale. . . 150 Stanford-Binet mental age: 
Army Scale mental age: 16 yrs . 9 mO . 

17 yrs . , 4 mo • 

Army Scale I. Q 120 Stanford-Binet I. Q 117 

High school subjects which Educational plans: 

pupU desires to take: To finish high 

English school then at- 

History tend a university 

Algebra or the U. S. 

French naval academy. 

Vocational ambition: Chemi — 

cal engineer or 
naval officer/ 

Grade of work done in elementary and intermediate schoob: 

Very poor. Estimated as "average" 
by some grade teachers, and as 
"below average" by others. 

Conunent of Examiner: Boy has ability but 

needs to be waked up. Suggest 
that he take general science in 
place of history for first 
year. Also suggest that he be 
placed in first division in alge- 
bra where he will have to work. 
He will need to develop ability 
in both science and mathematics if 
he is to follow his vocational 
ambition. 

The boy whose card is set forth above enrolled for English, 
algebra, history, and general science, upon entering high school. 
During his first half year he made grades of ''C" in English, and 
^^B" in each of his other subjects. This was a great improvement 
over the grades earned by him in the eighth grade. A recent 
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checking up shows that he has brought up his English grade and 
is maintaining college recommendation standing in all his work. 
The mental tests were an aid to his advisers in discovering how to 
spur him on to creditable achievement in his school work. 

CARD NO. 4 

Brown , Carri e Chronological age: 15 yrs . , 

Score Army Scale. . . 100 7 mO . 

Army Scale mental age: Stanford-Binet mental age: 

14 yrs,, mo., 14 yrs. , 2 mo. 

Army Scale I. Q 89 Stanford-Binet I. Q 90 

High school subjects which 

pupO desires to take: Educational plans: 

English To go to Mills 

Algetra College 

Latin Vocational ambition: To be 

Typing a Chemist. 

Drawing 

Grade of work done in intermediate and grammar schoob: 

Grades in 8A class only fair, even 
in work that is "being repeated. 
Estimates of elementary and inter- 
mediate teachers: "slow" "but 
a conscientious worker. 

Comment of Examiner: Should "be discour- 
aged as to taking Latin. Algebra 
doubtful, but if she insists in 
view of desire to go to college, 
assign to second division. 

The program finally worked out by Carrie Brown and the dass 
adviser included English, algebra, free-hand drawing, and typing. 
Her grades at the end of the first semester in high school were: 
EngUsh, "C"; algebra, "E" (failure); free-hand drawing, "C"; 
typing, "B." She had failed in algebra,, the subject coimted as 
doubtful by the examiner, and had earned less than college recom- 
mendation grades in the only other subjects that would be counted 
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toward entrance to Mills College. Even if she completes high 
school her chance of continiiing in college is not at all bright. 

A sufiEident number of sample cards have been described to 
illustrate the method employed. There was no coercion. Counsel 
and advice in the selection of subjects were all that was attempted, 
but the coimsel and advice offered were based on all the signi- 
ficant information with regard to mental lability, school success, 
vocational ambition, and teachers' estimates of ability, that could 
be obtained. Certain pupils elected to take subjects which the 
advisers felt sure they would fail in and made passing grades. 
Others taking subjects on the advice of the coimselors failed. 
Such cases simply illustrate the truth that no human agency, how- 
ever fortified with information or however careful to mix common 
sense with theories, can hope to be infallible. The general results 
of the experiment, however, were very satisfactory. 

3. Results attained by ^'guided'' and **unguided" higk-school 
pupils. — ^The original group of 107 high-school pupils which en- 
tered the Palo Alto High School in September 1916, were examined 
with the Stanford-Binet Scale after entering high school. They 
had already selected their courses of study at the time of being 
examined, hence can properly be designated as "the unguided" 
group. A comparison of the first year's work done by the mem- 
bers of the "unguided" group with the work done by the group 
that entered high school in February, 1918, and which had the 
benefit of counsel based on mental tests and other significant 
data, will illustrate the value of careful guidance as against the 
trial and error method of selecting high-school courses of study. 



TABLE I. 



COMPARATIVE FACTS REGARDING "GUIDED" 



AND "unguided" GROUPS OF HIGH-SCHOOL PUPILS 




Group 


Out at 
Work 


Per- 
cent 


Out by 
Transfer 


Per- 
cent 


Failed 
1 Subject 


Per- 
cent 


Failed 
2 or More 


Per- 
cent 


Guided 

Unguided . . 


1 
13 


4.5 
12.0 


2 

14 


9.0 
13.0 


4 

33 


18.0 
31.0 



11 


0.0 
10.0 



It is not exactly true to fact to designate the original group of 
107 as the "unguided" group. Most of them had been examined 
with the Stanford-Binet before the end of the first six- week period. 
Whenever the results of the first six weeks of school work con- 
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finned the indications of the mental tests that a pupil would prob- 
ably fail in such abstract subjects as algebra, Latin, etc., that 
pupil was permitted to drop the subject and continue the semester 
carrying but three subjects. The subject dropped at the end of 
the first six-week period was not coimted as a failure in compiling 
the data for Table I. The mental tests were utilized to aid in 
correcting the mistakes made by the pupils in the imguided selec- 
tion of their subjects. To this extent, then, the original group 
was guided, but the guidance came after, not before school work 
was begun. 

The number of failures registered against the ^'imguided'' group 
at the end of their first year in high school would undoubtedly have 
been greatly increased if it had not been for the limited guidance 
above described. This fact gives greater significance to the data 
presented in Table I. 

The median I. Q. of the imguided group was 105, and themedian 
I. Q. of the guided group was 108, a difference of three points in 
favor of the guided group, but this is not in itself an adequate 
explanation of the superior record made by the guided group dur- 
ing its first year in high school. 

The most significant facts to be found in Table I are those relat- 
ing to number of failures in one subject, and in two or more 
subjects. It appears that 31.0 percent of the unguided group 
failed in one subject, and 11.0 percent failed in two or more sub- 
jects during their first year in high school, while of the guided 
group only 18.0 percent failed in one subject and none of them 
failed in two subjects Since it has been shown that failures in 
school work tend to increase the percentage of elimination it is 
reasonable to attribute the small percent of elimination due to 
leaving high school to go to work, in the case of the guided group, 
to entire absence of failures in two or more subjects. 

The results of the above described experiment in educational 
guidance by means of mental tests would seem to justify the con- 
cRision that such tests may be of material assistance to the high- 
school administrator, if used in connection with other significant 
data. It is certain that the methods applied in this instance, if 
employed in any high school, would prove greatly superior to the 
wasteful "trial and error" methods that now prevail. 

4. Relatum of general level of intelligence to success in a given 
subject. — In Table 11 is shown the correlation between general 
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level of intelligence and high-school grades in algebra. The 
algebra grades are recorded under the letters A, B+, B, C, C— , 
D, and E. The I. Q.'s come under the groups 84-89, 90-94, 
95-99, etc. 

TABLE n. COKKELATION BETWEEN I. Q.'s AND GKADBS 
IN ALGEBRA OF 113 HIGH-SCHOOL PUPILS 
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(Stantoso-BinetI 






Grades 


80- 
84 


8;^ 

89 


90- 
94 


95- 
99 


too- 

!04 


105- 
109 


110- 
114 


115- 
119 


120- 
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125- Totals 
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1 
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1 
2 
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2 
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2 
3 
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1 
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2 
2 
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"E" ... 
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Tolflls 


1 


7 


11 


16 


15 


11 


16 


11 


U 


14 


113 



The correlation obtained, 0.46, which is nine times the prob- 
able error can be counted as having considerable significance. An 
examination of the data contained in Table II will show that 
twelve of the fifteen failures in algebra, or 80.0 percent of the total 
number of failures, were earned by pupils with I. Q.'s below 100. 
There were 35 pupils having I. Q.'s below 100, and 26 of them, or 
74.3 percent earned marks below "B," which is the college recom- 
mendation grade in California, On the other hand there were 78 
pupils with I, Q.'s above 100, and 45 of these, or 63,0 percent, 
earned marks of "B" or above. An I. Q. of 120 or over denotes 
very superior intelligence. There are 25 cases with I. Q.'s 120 or 
over in Table II. All of these succeeded in earning passing grades 
in algebra. Only one received a mark as low as "C— ." 

High-school statistics show that algebra is responsible for more 
failures of first-year pupils than any other subject. Table H 
suggests that probable success or failure in algebra can be inferred 
from the general level of intelligence as disclosed by mental tests. 
It follows that the high percentage of failure in a^bra could be 
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materially reduced if only those were encouraged to take the sub- 
ject whose general level of intelligence measured up to average or 
better. 

5. Station of score in a particular mattal test to sttccess in a 
given Hgh-school subject. — Test No. 9, in Army Scale, Group 
Examinations a and b, is a "word relations" test. It involves a 
knowledge of word meanings and also the ability to use words 
intelligently in their proper relations to one another. Table in 
compares the scores made by 1 7 1 first-year pupils of the Palo Alto 
High School in Test No. 9, with the grades made by the same 
pupils in English during their first high-school year. 
The directions for giving the test are as follows: 
In eack of the lines below, the fint two words h&ve a certcin idation. Notke 
that relation and diaw a line under the one word in the pueotbeua lAicb baa tb>t 
particular relation to the third word. Begin with No. 1 and mark as many seta as yon 
can before time b called. 

Sample sets are then given by the examiner to illustrate what 
is wanted: 

sky — blue: grass — (grow, green, cut, dead) 
fish — swims; man — (boy, woman, walks, girl) 
day — night: white — (red, black, cleat, pure) 

TABLE m. COESELATION BETWEEN GBADES IN ENGLISH AND 

SCOKES IN GKOUP INTELLIGENCE TEST NO. 9 Of 

AKUY SCALE, OF 171 HIGH-5CB00L PUPILS 



Marks in 


Scores in Teat No. 9, Examinations a and b 


First Year 
English 


1- 

4 


5- 
9 


10- 
14 


15- 
19 


2fr 
24 


25- 
29 


30- 
34 


35- 
39 


40 


ToUb 










1 
1 
5 
11 


4 
7 
16 
17 
1 
1 
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14 
19 
8 
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3 
10 

6 


2 

2 
6 
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1 
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5 
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11 


24 


A6 


43 


32 


12 













Correlatitm (Peanon): 0.48 
Probable ei 



There were forty sets of words and the time allowed was three 
minutes. For pur[>oses of tabulation the scores made by the 
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pupils are grouped: 1-4, S-9, . . . 35-39, 40-. The English grades 
are indicated by the letters A, B+, B, C, C— , D and E. 

The correlation, 0.478, is twelve times the probable error and 
indicates that a good score in the "word relations" test is a fairly 
good index of ability in first-year high-school English. The marks 
in English were the final year marks, which represent the minimiiTn 
of "D's*' and "E's," because all conditions and failures had been 
removed that could be made up. The median score in Test No. 9, 
was 26, hence scores of 30 or over could be considered superior. 
There were 44 pupils who made scores of 30 or over, and 36 of these 
or 82.0 percent made marks in first-year English of "B" or above. 
Of the 89 who made scores of from 20 to 29 inclusive, 68.7 percent 
made marks in first-year English of "B" or above. While of the 
38 who made scores of from one to nineteen inclusive, only 23.7 
percent made marks of "B" or above. 

Stated in terms of recommendation for college the above analy- 
sis of the data of Table III means that 76.3 percent of the high- 
school pupils whose ability in word relations is represented by a 
score of less than 20 fail to secure a college recommendation grade, 
while only 18.0 percent of those who attain a score of 30 or over in 
the same test fail to secure such a grade. 

These results seem to indicate that a series of tests involving 
the fundamental traits of mind essential to the successful study of 
English could be devised. But there are so many mental traits 
involved in the mastery of the subject of English that a series of 
tests bringing into play all those traits would undoubtedly be 
foimd to be a good test of general intelligence as well as a test of 
specific ability in English. 

Summary and Conclusions 

1. The results of an experiment in educational guidance, in 
which all the members of an 8A class about to enter high school 
were given mental tests and advised with reference to their first 
year high-school work, proved very satisfactory. Compared with 
an unguided group it was found that while 31 percent of the un- 
guided group failed in one subject, and 11 percent failed in two 
subjects during their first high-school year, only 18 percent of the 
guided group failed in one subject and none of them failed in two 
subjects. The mental tests aided in the discovery of the pupil's 
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general level of intelligence, made possible the giving of sound 
educational advice at the time when it would do the most good, 
and thus tended to reduce the percentage of failure and 
elimination. The methods employed can be adapted to the 
needs of any high school. 

2. The general level of intelligence is shown to have real signif- 
icance as a means of predicting success in a particular subject, 
such as algebra. In Table II it was shown that 100 percent of 
those having I. Q.'s of 120 or over passed in their algebra, while 
40 percent of those with I. Q.'s below 100 either failed or were con- 
ditioned in algebra, and only 20 percent of the members of this 
group earned college reconmiendation grades. The general level 
of intelligence could be relied upon as a means of selecting those 
who would be most likely to succeed in algebra and kindred sub- 
jects. 

3. Success in a particular test of a series may be a fairly reliable 
index of success in a high-school subject involving the mental 
traits supposed to be measured by the test in question. High 
scores in the "word-relations" test of the Army Scale, Examina- 
tions a and i, correspond generally to high marks in first-year 
high-school English, while scores below twenty in the same test 
correspond generally to low marks in the same subject. 

4. Mental tests for purposes of prognosis in individual high- 
school subjects such as algebra, English, etc., could no doubt be 
devised. But the mastery of any high-school subject involves 
such a complex of mental traits that any test which proves to be a 
good test of ability to succeed in one subject is quite apt to be 
foimd a good test of general mental ability. It has already been 
shown that a high-school pupil having a high level of intelligence 
will probably succeed in all of his subjects, and conversely that 
a pupil having a low level of intelligence is apt to fail in most of his 
high-school subjects. The best way, therefore, in which to arrive 
at an estimate of a given pupil's probable success in a specific high- 
school subject is to discover the general level of his intelligence. 
It follows that standardized mental tests may render invaluable 
service in the educational guidance of high-school pupils. Partic- 
ularly will this be foimd to be true if the results of the mental test 
are interpreted in the light of other significant data, such as 
school marks made in previous grades, teachers' estimates of 
ability, and educational and vocational plans. 



THE OPERATION OF BUREAUS OF EDUCA- 

TIONAL RESEARCH— WITH PARTICULAR 

REFERENCE TO WISCONSIN 

W. W. Theisen 
State Department of PiMic Instruction, Madison, Wisconsin 

A remarkable development in scientific methods of studying 
educational problems has taken place within the past few years — 
a development which has made it possible for well-informed 
persons to know more fully and accurately than ever before the 
possibilities and limitations of educational improvement. 

The evidence of this development may be foimd in many 
types of material, e.g., in numerous published surveys, school 
reports, reports of educational conferences, bulletins of bureaus 
of research, scores of recent educational monographs, and hun- 
dreds of magazine articles. Our methods of treatment of the 
statistics of attendance, progress and promotion, courses of study, 
teaching personnel, buildings and equipment, and finance have 
been greatly improved; while more noteworthy than any other 
has been the advance in the technic of measuring the achieve- 
ments of pupils. 

Unfortunately, however, the utilization of these scientific 
methods is still far from common in school practice. Moreover, 
the knowledge of what has been done and can be done in educa- 
tion is still largely the possession of a few. The problem now is 
to make these methods and this knowledge widely available and 
practically effective. To accomplish this the results, methods, 
and spirit of investigation must be put into operation in every 
school. 

The so-called bureau of research is the most active and 
effective agency today for making these newer developments a 
part of our practice. Without the intelligent direction and 
supervision of such an agency, teachers and administrators will 
not benefit to the fullest extent from our advance in scientific 
methods. Scientific supervision of this sort enables the weak 
schools to gain strength and the strong to grow still stronger; 
makes the successful activities of one school available for others; 
and develops teamwork among schools. Incomparably more 

382 
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effective are the united efforts of such schools than the spasmodic 
efforts of single schools. It is the function of bureaus of school 
research to provide supervision of this kind, and to bring about 
over a large area the application of scientific procedure to problems 
of administration, supervision, and teaching. School systems that 
have installed research bureaus have come to stand out in 
marked contrast with others that have failed to do so. 

Measxtrement of Instruction as a Bureau Problem 

The problems that should command the attention of bureaus 
of research are many. One of the most important is the problem 
of applying scientific procedure in measuring and improving the 
product of instruction. At present only a comparatively few 
principals and teachers can be expected to proceed imaided. 
Those who can, will nevertheless lack the stimidation which 
results from a knowledge of the success of others in wrestling with 
the same problems. The need of supervision of educational meas- 
urement in this restricted sense arises from another source. 
Many of our school systems, dty and state, are deficient in the 
amount of helpful supervisory aid which they can give to teachers. 
Educational measurement furnishes a very fruitfid instrument of 
supervision. With a comparatively small expenditure of mone^, 
a large number of schools and teachers can be effectively reached. 
This fact has imdoubtedly had its influence on the rapidity with 
which bureaus of educational measurement, or research, have 
developed. Such organizations ought soon to be foimd in every 
state and in every dty of large or moderate size. 

Educational measurement on a large scale involves the co- 
operation of superintendents, prindpals, and teachers. It is 
the task of bureaus of research to build up such cooperation. 
To secure it requires well-directed efforts on the part of those in 
charge of the bureaus. In the first place, it should be assumed 
that the large majority of superintendents, prindpals, and 
teachers are progressive at heart, that they earnestly desire to 
know how they can improve the quality of instruction, and that 
they will dedde upon a wise course of procedure, if the facts are 
dearly presented. In the second place, it will be necessary to 
make a dear presentation of the merits and possibilities of educa- 
tional measurements, and in doing so there will be abimdant 
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opportunity for the employment of tact and good judgment. 
Moreover, the supervisor or director in charge must maintain 
first-hand contact with the schools through field work. Without 
it he will not be in a position to realize the possibilities and 
limitations of local schools and teachers, nor can he prescribe 
accurately for their improvement. This is exceedingly important 
in all the bureau work of a state department or imiversity. 

The attitude of those whom the director hopes to reach will 
depend upon their previous acquaintance in the field of educa- 
tional investigation and measurement. For convenience we may 
divide school heads and teachers into three groups: Group I: 
those partly acquainted with educational measurements and their 
uses, as a result of what they have read or have heard on various 
occasions; Group II: those wholly, or almost wholly, unfamiliar 
with the newer developments in educational investigation; and 
Group III: those who have had considerable experience in 
their application. The director's efforts to stimidate educational 
research will differ in each of these cases. 

Group I. Those Partly Acquainted with Educa- 
tional Measurement 

Most superintendents even in states which do not support 
bureaus of research, are partly acquainted with educational 
measurements and their uses. They are, therefore, for the most 
part in a receptive mood. Although they are often eager to 
begin actual investigation, they, nevertheless, hesitate because 
of unfamiliarity with the details of procedure and lack of confi- 
dence in their own ability. In such cases, the presence of the 
supervisor or director is all that is needed to set the movement 
on foot. 

In visits to schools of this type, the director must adopt a 
sympathetic attitude. He must endeavor to find out what the 
schools have tried or are trying to do. By so doing he will discover 
wherein his own services will be of most help. Among other 
things, he should make inquiry as to the superintendent's plan 
for the professional development of his teaching staff. Again, he 
should learn what subjects of the curriculum are being attached 
with a view to improving instruction. The services of the director 
will usually be most welcomed, if he exhibits a desire to aid in 
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carrying out the superintendent's plans. With this point as a 
beginning he will be in a position to make recommendations for 
additional lines of investigation. 

Where such schools have already planned to make some appli- 
cation of educational measurements, they will welcome the 
director's aid and guidance in the details, such as administering 
a test, and scoring and tabulating the results. While we do not 
believe that much of his time should be spent in this fashion, such 
assistance is often quite necessary in new fields. As far as possible, 
however, his time should be given to interpreting and teaching 
others how to interpret the results attained, assisting teachers 
in the finer diagnostic analysis of results, making suggestions for 
remedial work, and planning for further experimentation. By 
all means he should make it a point to meet teachers and princi- 
pals individually and in groups. The findings and suggestions 
can then be made the subject of discussion. It is very important 
that teachers be made to feel that their use of measurements must 
not stop with a compilation of results, and it is at this point that 
the services of the director are most needed. Without construc- 
tive guidance much well-intentioned effort is apt to coimt for 
naught. 

Where the supervisor or director finds it impossible to be 
present in person, he can assist materially through correspondence. 
When he is asked for information on such matters as school 
building standards, grading and promotion standards, available 
tests in various subjects and suggestions as to their use, he is in 
a position to help superintendents or principals to proceed wisely 
and to steer them away from pitfalls. In the case of tests, he 
should ask in each instance that a copy of the residts be sent him 
for examination and criticism. 

Group II. Those Unacquainted with Educational 

Measurement 

Every director, particularly in a new field, must expect to find 
some superintendents, principals, and teachers who are to all 
intents unacquainted with educational measurements and their 
significance. He should endeavor to reach as many of these as 
possible, thus recruiting the ranks of those better acquainted with 
the field. There are several avenues and instruments of approach 
that can be used to good advantage, e.g., conventions of superin- 
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tendents and principals, teachers' institutes and other educational 
gatherings and the colunms of state educational publications. 

The most fruitful reward of efifort in this direction results, as 
before, from personal visitation. This offers opportunity to 
"talk things over,'* to tell what has been done elsewhere, to show 
samples of standard tests, to tell how they may be used, to point 
out their merits and demerits, to indicate the benefits to be gained 
from their application, and to suggest lines of investigation. If 
this part of the work is well done, it will usually result in an 
invitation to imdertake some experimentation, to supply some 
standardized tests, or possibly to meet with the teachers and ex- 
plain to them the uses of sudi tests. New bureaus will find this 
t)rpe of field work advisable whenever it is at all possible. 

Group III. Those Experienced in Educational 

Measurement 

In schools that have already made more or less use of scientific 
methods of attacking educational problems, the director's efforts 
can be centered upon an analysis of some of the residts and their 
implications. It should be his business to see, for example, that 
the diagnostic phase of testing is properly imderstood and empha- 
sized. It will be a part of his task to demonstrate from the actual 
papers of the children the diagnostic values and possibilities of 
the tests used, to suggest forms for tabulating and effectively 
representing the findings, to indicate possible needed revisions 
in teaching method, course of study, or gradation of pupils, to 
propose additional equipment in the way of books, maps, scales 
for testing, practice materials, etc., and to plan lines of further 
research and experimentation. Clearly, the director should be a 
good general supervisor of instruction. He will often find it 
impossible to give each school all of the personal attention it 
needs. If, however — as in a state department — there are general 
supervisors of instruction at work out in the field, they can be 
instructed and enlisted to aid in carrying out remedial measures 
in local schools. Their cooperation will be extremely valuable. 

Not too much should be expected of schools at the start. In 
the first place, it is not advisable to attempt many lines of investi- 
gation in a given school system, particularly if several of them 
affect the same teachers. When standardized tests are applied, it 
is well to confine the testing to one subject at a time. Rarely 
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should more than two be attempted simiiltaneously. If too 
many tests are undertaken, confusion results, and the satisfactory 
treatment of any one of them is difficult. The professional ener- 
gies of the teaching staff should be organized for a '^drive" on the 
subject chosen. Not until its objectives have been reached shoidd 
other subjects be attacked. In Wisconsin it has been the practice 
in most instances to set the dates for successive cooperative tests 
so that a period of two months or more may intervene between 
tests in different subjects. Arithmetic may be tested in Novem- 
ber and reading in February. This allows the teachers and 
principals some time to work out remedial measures. If we may 
be permitted to offer a criticism upon our own work, it is that 
during the first year we failed to allow sufficient opporttmity for 
this sort of concentration. In the second place, simple tests 
should be selected for use in all schools that have had no previous 
experience with tests, or experience of a very limited kind. In 
such schools, the many administrative details connected with 
the more elaborate tests only serve to obscure their real purpose. 

After the Work Has Been Well Started 

The program outlined thus far has to do with the initial 
building of a foimdatipn for educational researdh. After a group 
of superintendents has been trained to proceed with research 
and experimentation, the work of the director becomes somewhat 
different in character. If possible, an annual conference of school 
heads should be arranged. A number of states now hold such 
conferences, the best known being those held at Indiana Univer- 
sity. At such gatherings the results of previous efforts can be 
reviewed. Matters for cooperative investigation proposed for 
the year can be discussed and voted upon. At such times it is 
the business of the director to bring to the attention of the 
assembled school heads the most recent developments in scientif- 
ic procedure in education, and to call their attention to the best 
recent literature on the subject. If possible at this time, it will 
be well to bring before the conference some prominent workers 
in the field of educational research from the outside, who are 
capable of stimulating further educational investigation and 
professional growth. After a few days of wholesome discussion 
the director's suggestions and those made by superintendents 
and others can be finally considered and lines of investigation 
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voted upon. Superintendents should be made to feel that the 
choice is their own. Dates that are opportune should be chosen. 
A bureau of research should at all times act as a source of 
information for teachers, supervisors, and superintendents on 
questions relating to the most effective methods in teaching, 
supervision, or administration. A part of its function is to sug- 
gest the most recent studies of practical value, to issue reviews of 
stimulating and suggestive articles and monographs in the field 
of education, and to send out bibliographies of the best publica- 
tions pertaining to problems under investigation. 

Educational Measurement in Wisconsin 

Organized work in educational measurements in the schools of 
the state began in the fall of 1916 with the appointment of a 
director of educational measurements by State Superintendent 
C. P. Gary. Previous to this, the efforts to carry on educational 
measurements in the state were quite meager and more or less 
spasmodic. Since then a definite policy of cooperative educa- 
tional investigation of school conditions has been pursued. 
Superintendent Gary's main purpose in establishing the bureau 
of educational measurements was to bring about a general im- 
provement in the achievements of pupils throughout the state. 
It was his belief that instruction lacked the quality of thorough- 
ness which should be demanded. The results of investigations 
to date have fully substantiated this position. 

While attempting to carry out the purpose just mentioned, 
the bureau does not limit itself to efforts at improving the work 
of classroom teachers and supervisors directly. It seeks to 
improve administrative procedure and educational conditions. 
General school surveys and surveys of particular phases of local 
school problems are undertaken. The Janesville survey has 
been published as an example of a general survey. Among 
other things, efforts are made to secure increased financial support 
for schools, more economical distribution of school fimds, better 
buildings and equipment, higher salaries for teachers, selection of 
better trained teachers, and improved gradation of pupils. 

With the exception of the tests applied in dties during the 
first year, standardized educational tests have been given chiefly 
on a cooperative basis, made possible through the generous 
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response of two bodies — one the dty superintendents and the 
other the county superintendents and supervising teachers. 
Each group is met annually in conference. At these conferences, 
plans are taken up for cooperative testing for the year. In addi- 
tion to the groups mentioned above certain other groups, such 
as the teachers in state normal schools and those in the coimty 
training schools for teachers, are called upon at times. 

The schedule carried out since the bureau has been in operation, 
the classes and numbers of schools reporting complete residts, and 
the numbers of children tested may be seen in the accompanying 
table. 

The foregoing tabulation by no means represents all of the 
testing done during this time. It usually happens that a number 
of schools find it inadvisable or inconvenient to give the tests at 
the particular time set, and that others make incomplete or late 
returns, or make no returns at all. Many schools give a number 
of tests in addition to the cooperative tests, depending upon the 
nature of the local problem. With the aid of the bureau a number 
have been making use of group intelligence tests. Superintendents 
are becoming more and more alert to the necessity of more 
accurate classification and gradation of pupils. During the year 
1918-1919, the bureau administered its own group intelligence 
tests to students in seven of the state normal schools, as a means of 
aiding the normal schools in studying the quality of the prospec- 
tive teaching material. 

In addition to the testing, an increasingly large number of 
schools are engaging in definite experimental studies of special 
phases of instruction. During the current year intensive remedial 
work in reading is being emphasized more than any other topic. 

The state supervisors, in their visits to schools, are using the 
facts discovered through the application of tests. They meet 
teachers, principals, and supervisors individually and in groups. 
At these meetings they discuss the test residts and their applica- 
tions to teaching method, course of study, equipment, and 
gradation of pupils. This personal contact of the state super- 
visors with the teachers — a contact in which the teachers are 
helped to make the applications — ^is an essential and vital part 
of the work as it is carried on from the Wisconsin State Depart- 
ment of Public Instruction. 
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SUMBCARY OF COOPERATIVE EDUCATIONAL TESTING IN WISCONSIN 

1916-1917* 



Schools 


Subjects 


Test 


Scope 


No. of 
Children 


Rural 


Spelling 
Writing 

Spelling 

Writing 

Spelling 

Arithmetic 

Reading 

Writing 

Composition 


Ayres 
Thomdike 

Ayres 

Thomdike 

Ayres 

Woody-A 

Kansas 

Thomdike 

Hillegas, Trabue 


1173 schools 
173 " 

132 " 
9 " 
35 cities 
21 " 
18 " 
11 " 
15 " 


15.825 


tt 


2,625 


"State graded" 

(small village) 

"State graded" .... 
City 


7.465 

720 

13,111 


^•"^•j ••• 

ft 


7.500 


tt 


7.549 


11 


3.866 


»i 


d,o4o 



1917-1918 



Rural. 



t( 



City 



(I 



It 



11 



• •• •••••* 



Arithmetic 
Arithmetic 
Reading 
Arithmetic 

Algebra 



Stone-Original 
Woody-A 
Thomdike Alpha 2 
Stone-Original 

" -Equivalent 
Hotz 



27 counties 

31 

34 cities 

59 " 

33 

22 



It 
It 



335 
10,840 

9321 
18,495 
11,010 

1,663 



1918-1919 



Rural. 



It 



City 



It 
tt 



Co. training and 
teacher training 
classes in H. S. . . 



Spelling 
Reading 



11 



Arithmetic 
Latin 

{Reading 
Anthmetic 
" 



Buckingham 
Monroe 



It 



Theisen-Woody 

Brown 

Thomdike A 

Rate 

Woody 

Stone 



45 counties 

43 " 

32 cities 

29 

15 

50 schools 

41 

48 

44 



tt 



11 



It 



11 



tt 



9,322 

9,090 

20,254 

12,839 

1,334 

• * • • 
1,304 
1,214 



1919-1920 



City. 



tt 
11 



Rural. 



Spelling 
Reading 
History 
Arithmetic 



Ashbaugh-Iowa 
Monroe Form II 
Van Wagenen 
Theisen-Woody 




* During the first year, 1916-1917, the tests in cities were given at the time of the 
director's visit. In succeeding years a definite date was fixed for the giving of the testa 
in all schools. 

* Returns are just now coming in. ' To be given during the present year. 
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Some attention is given to the training of prospective teachers 
in the use and application of standardized educational tests. 
Teachers shoidd possess at least a preliminary understanding 
and appreciation of the purposes and values of such tests when 
they enter upon their duties. State normal schools are urged to 
offer courses giving specific training in the application of stand- 
ardized tests. The state supervisors of educational measurement 
assist in the preparation of such courses. A nimiber of Wisconsin 
state normal schools now offer training in educational measure- 
ments either as a separate course or as parts of other courses in 
education. 

The personnel of the bureau includes, in addition to the director, 
an assistant director, Mrs. Cedle White Flemming, Supervisor of 
Educational Measurements, and a statistical secretary. Miss 
Elizabeth A. Ahem. Besides the immediate staff the bureau has, 
as has been said, the benefit of the cooperation and assistance of 
other members of the staff of the State Department of Public 
Instruction. Temporary clerical and statistical assistance is 
secured from time to time to aid in busy seasons and when material 
requested by superintendents is to be prepared. It is to be re- 
gretted that sufficient fimds are not provided for clerical assistance 
of a permanent sort. This need is sorely felt by reason of the fact 
that many schools look to the bureau as a clearing house for 
information on such matters as comparative salaries, comparative 
school costs, school buildings and equipment, comparative figures 
on standard tests, age-grade statistics, etc. 

Aside from its direct service to Wisconsin schools, the bureau 
of the state department is called upon from time to time for 
suggestions for the application of educational measurements 
and the development of new bureaus in other states. No doubt 
other bureaus have had many similar requests. Such requests 
are an indication of the growing demand for the application 
of scientific methods of procedure in educational administration 
and supervision. 



PUTTING STANDARDIZED TESTS AND SCALES 
TO PRACTICAL USE IN THE RURAL SCHOOLS* 

Samuel S. Brooks 
Distrid Superintendent, Silver Lake, New Hampshire 

A supervisory district containing 26 rural, ungraded one-room 
schools with teachers for the most part inexperienced or untrained, 
a majority of whom had never worked under a superintendent be- 
fore this, was the opportunity that fell to my lot when I became a 
New Hampshire superintendent under the new law eflFective 
September 1, 1919. It was my first experience as a superintend- 
ent. Truly the district was "virgin soil" as a member of the 
state department remarked to me when I took the position. 

Sizing up the Situation 

The first two or three weeks were spent in traveling about the dis- 
trict getting acquainted with the teachers and sizing up the situ- 
ation. Most of the schools had already begun, the teachers having 
been hired by the local school boards as in the past. I found that 
three of the teachers were normal-school graduates, and that two 
had attended one summer school ; but the others had no professional 
training whatever. Several had not attended school beyond the 
eighth grade, but had taught from ten to 28 years in the same 
school. Three were inexperienced high-school graduates in their 
'teens. Fifty percent of all the teachers had never seen a profes- 
sional book or magazine and did not know where to obtain one. 
All this of course had resulted in an ingrowing provincialism which 
could not but have a disastrously narrowing effect on their teach- 
ing. They were imitators of imitators. Their methods were in 
imitation of the teachers who had taught them and who, in their 
turn, had imitated their own teachers. The results were the use of 
methods and texts so archaic as to be amusing if they had not been 
at the same time such a sad commentary on our boasted educa- 
tional system. 

' This is the first of a series of articles describing some of the problems confronting 
an inexperienced superintendent of a rural district in New Hampshire and his attonpts 
to solve them with the help of standardized educational tests and measurements. 
— Editor. 
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Most of the textbooks were sadly out of date. Arithmetics, 
geographies, grammars, and even histories published in the 
eighties were in daily use. One of the local committees insisted 
that they must be good books or they would not have worn so 
long. Of course the books were all based on the defimct doctrine 
of formal discipline and showed little of the psychological methods 
of presenting material which are the basis of modem educational 
procedure. The idea seemed to be that an arithmetic is an arith- 
metic, and a geography is a geography and that one book is as 
good as another so long as nothing pertaining to the subject is 
omitted and the leaves are all present. 

I have emphasized the teaching and textbook situations because 
I consider them the most important factors. A few other points 
I shall mention briefly. As for the schoolhouses, it is sufficient to 
say that most of them were typical New England rural school 
buildings of ancient vintage, modelled variously (according to the 
idea of their instigators), upon churches, town halls, bams, and in 
some cases it would almost seem, upon pigpens. They were 
small, dirty, poorly heated, lighted and ventilated, and in short 
generally unsanitary and ill-suited to their purpose. As to the 
organization of the schools, as I have already intimated, no 
attempt had ever been made to grade them. Another important 
factor in the situation was the attitude of the communities toward 
expert supervision. Three of the four towns in the district had 
always opposed such supervision as long as it was optional and 
were not inclined to submit gracefully when according to the 
provisions of the new law it became compulsory. Such were the 
general conditions as revealed by my preliminary survey. 

However, there were three bright spots in the general darkness 
of the situation. First, the splendid new state school law which 
made the superintendent a state official with a pretty free hand 
and which provided liberal state aid for rural schools where it 
might be necessary to keep them up to the required minimum 
standards. Secondly, intelligent school boards willing to co- 
operate. And last, my own professional equipment which in- 
cluded a pretty thorough training in educational measurements 
and an earlier experience in the teaching of rural schools. Accord- 
ingly, I tackled the proposition determined to show what scien- 
tific method in education could do for mral schools if it had the 
chance. 
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Analyzing the Situation 

The following week was spent in analyzing the conditions found 
to exist and in deciding upon the most efficient way to bring order 
out of chaos. As a result of this analysis a number of definite 
problems seemed to stand out clearly demanding early attention. 
From among these problems I shall select, for present discussion, 
only those, in the solution of which as it seemed to me, standard- 
ized tests and scales could be used to good advantage. 

Problem 1. — To grade the schools fairly and accurately. — Getting 
the schools graded in order to start the pupils right for their 
year's work was of course the most urgent problem. It would 
have been a comparatively simple matter to grade them arbitrar- 
ily on the basis of the teachers' judgments. But there are serious 
objections to this method even as a beginning, especially when the 
teacher is new to the school. If, for example, children are placed 
in grades lower than their parents think they ought to be, there is 
bound to be some strenuous objections from some of these parents 
and the only evidence one has to oflFer is that the teacher thought 
the children ought to be placed in those grades. Did you never 
hear this line of talk from an irate parent? "My John is just as 
smart as Mrs. Smith's Henry and he ought to be in the same class 
or above. It's a plain case of showing partiality so there now! 
Ejust won't stand it!" 

j^It is not by any means easy in such cases to prove to the 
satisfaction of the parent that the teacher has a sound basis for 
her judgment. And the fact is that she did not have a sound 
basis. How did she know just what knowledge or ability a child 
should exhibit in order to belong in a certain grade? What stand- 
ards of achievement did she have for the different grades besides 
her own arbitrary judgment? 

Giving ordinary tests for grading purposes is also inaccurate and 
unfair, because such tests are devised by the teacher or superin- 
tendent and hence represent merely their judgment as to what 
they think a child ought to know in order to be placed in a certain 
grade. 

Worse than all else, the children themselves are apt to become 
discouraged, not understanding wherein they have failed, and 
being at a loss as to just what they are expected to achieve. Even 
the superintendent and teachers, if they are consdentious, are 
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not satisfied because they cannot feel sure that injustice has not 
been done. Retarding a child without good reason, thus robbing 
him of a year of his time, is a serious matter, at least for the child. 

What method of grading then could be foimd which would 
be fair to all concerned? After casting about for some time 
for a solution to this problem, it suddenly occurred to me that 
standardized tests would help me out of my difficulty. Did 
they not offer defiinite standards of achievement for each grade? 
And those standards were not based on imattainable 100 percent 
perfection nor upon the opinions of dogmatic educators as to what 
a child ought to know at the end of a certain grade. They were 
experimentally derived and based upon the amoimt of work that 
normal children are actually doing in the different grades through- 
out the whole country and not upon the amoimt of work somebody 
thinks they ought to do. 

By giving these tests in all my schools I could determine just 
where each child belonged on the educational ladder. The proc- 
ess would be roughly comparable to measuring a large number of 
sticks of various lengths by means of a tape measure sorting them 
into eight piles, each pile containing sticks of about the same 
length. Then when angry parents wanted to know why their 
children were graded so low, I could show them. The children 
themselves could be made to see wherein they had fallen below 
standard and what they would have to do to come up to the 
standard. Both superintendent and teachers would feel that 
they were on solid groimd. Surely I needed standardized tests 
the first thing. 

Having reached this conclusion, I immediately ordered all the 
tests and scales I knew of that were sufficiently well standardized 
for my purpose. They covered the following subjects: arith- 
metic, silent and oral reading, spelling, writing, geography, history 
and English language.' 

Problem 2. — How to measure the progress of pupils. — Having 
settled upon how to do the preliminary grading, die next problem 

* For those who do not know standardized tests and want to get acquainted I 
recommend for a beginning the purchase of Measuring the Results of Teaching by 
Monroe, and Educational Tests and Measurements by Monroe, DeVoss, and Kelly. 
Both books describe the best tests and their uses and the former tells where to obtain 
thenL These books are published by Houghton Mifflin Company, Boston and else- 
where. 
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was to find a just method of measuring the progress of pupils for 
promotion purposes. The same objections to teachers' tests hold 
good here as were noted in discussing the previous problem. 

This problem involved, obviously, the finding of a satisfactory 
system of marking. It has been proved beyond doubt that 
ordinary teachers' marks are unfair, inaccurate, and generally 
imsatisfactory as a means of measuring progress or as a basis for 
promotion. 

In measuring the progress of pupils, standardized tests must 
surely find their widest field of usefulness. Here the process can 
be compared to standing a ten-foot measuring rod beside a young 
tree when it is a foot high and noting its growth in height. When 
it has added another twelve inches it belongs in the two-foot class. 
Twelve inches more and it is promoted to the three-foot class, and 
so on. It is even possible to devise a satisfactory system of mark- ^ 
ing, for report card purposes, with the aid of such tests, as will be 
explained later on. 

Some of the teachers thought that the new state program of 
studies for elementary schools would be suflBident guide for pro- 
motion purposes. This program is thoroughly practical and up- 
to-date. But it offers no definite, objective standards of achieve- 
ment from grade to grade. Therefore it is not a satisfactory tool 
with which to measure the progress of pupils and to determine 
when they are ready for promotion. It is true that a printed 
program of studies specifies the subject-matter to be covered by 
each grade but it is left entirely to the judgment of the teacher 
as to when that subject-matter is covered satisfactorily. The 
ground may be gone over more or less thoroughly and with very 
unequal results according to the methods and arbitrary standards 
of the individual teacher. Hence, it is obvious that programs of 
study cannot take the place of standardized tests that are even 
fairly objective. 

Problem 3. — How to measure the ability of teachers, — One of the 
greatest needs of superintendents is a method of measuring the 
ability of teachers that will be accurate and fair to all concerned. 
A method that will not leave the superintendent open to the 
charge of favoritism or poor judgment. A method that will 
satisfy a teacher who has been rated something less than 
''excellent" that her shortcomings are real and not hallucinations 
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in the mind of the superintendent due to his personal dislikes and 
prejudices. 

What is wanted is concrete evidence of a teacher's ability or 
lack of ability that will allay carping criticism from whatever 
source. It is decidedly neither accurate nor fair to estimate a 
teacher's ability solely by observation made by the superintend- 
ent during his visits to the classroom. It is not fair because (a) 
such observations do not furnish a sound basis for judgment, (b) 
the superintendent's opinions are quite apt to be colored by 
personal prejudices toward an individual teacher or her methods, 
(c) classes often show at their worst in the presence of visitors, (d) 
even the teacher may fail to do herself justice tmder the critical 
eye of the superintendent. It is inaccurate for all the reasons 
noted above and because (a) some teachers do excellent work when 
the superintendent is present and shirk all the rest of the time, 
and (b) if such teachers do their own testing, even the results may 
be made falsely to appear satisfactory. 

Provided a teacher is of good moral character with high ideals 
and a fairly pleasant personality, her further desirability as a 
teacher is measured by the results she gets as determined by the 
progress of the pupils when such progress is objectively measured. 
After all, it is results we are after, primarily. Hence, the stand- 
ardized tests measure objectively both the progress of the pupils 
and the ability of the teacher at one and the same time. 

Probtem 4. — To find a practical method of supervising study and 
of teaching how to study, — This may seem like a large contract for 
the one-teacher rural school with its crowded curriculum, but I 
shall try to show that it can be successfully worked out by using 
proper methods of study supplemented by judicious use of the 
standardized educational tests and measurements. 

This paper merely presents some of the problems confronting 
me in my new work together with some plans for their solution and 
reasons therefor. Following articles will describe in detail the 
working out of these plans and the results achieved. 



COEFFICIENTS^OF REGRESSION 

Leonasd p. Aykes 
RmudlSaitPi 



In the Mar(± aiid Aprfl nombeis of the JoxTSXAL OF EorcATnni^ 
Research there were published articles by the writer on shorter 
methods for computing the coefficient of correlation. The object 
of the present article is to describe a short method Ux computing 
the coefficients of regression and to comment briefly on the prac- 
tical utility of that measure of relationshq>. 

The coefficient of regression is a measure which tells how much 
change takes place in one of two series of paired values for each 
change of one unit in the other series. Suppose we have a set of 
figures giving the ages and grades of the children in a school 
system. Since the plan of the system is that children shall be 
promoted one grade each year, it is sure that there will be a hi^^ 
correlation between the two series. 

We know, however, that in nearly aU school systems many 
children fail to go forward at the rate of a grade each year and that 
the average progress is in marked degree less than the ideal. The 
coefficient of regression is the measure whidi will tell us what the 
average rate of progress is. It will tell what the diange is in 
grades for each change in years or what part of a grade the average 
child tends to advance for each additional year of age. This is 
what is meant in this particular case by the statement that the 
coefficient of regression shows the change in one series for a unit 
of change in the other. 

The formula for the coefficient of regression, as it has ordinarily 
been stated, is not easy to use or tmderstand, but its difficulties 
are mostiy easy to avoid. Its use will be illustrated by finding 
it for two correlations, one for a short list of paired values and the 
other for a table of distribution. The formula for finding the 
coefficient of correlation is the one explained by the writer in the 
two previous articles published in this magazine. It is as follows: 
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Sum of products of subject and relative items 

minus 
av. of subject items X tot of relative items 




Sum of squares of sub. items Sum of squares of rei. items 

minus jC minus 

av. X total of these items av. X total of these items 

Let US apply this formula to a short list of paired values repre- 
senting the ages and grades of ten school children. Two of them 
began school foxir years ago, two three years ago, two two years 
ago, two last year, and two this year. They all entered at the age 
of six. One of each pair went forward one grade each year while 
the other spent two years in each grade. Their ages and grades, 
together with the computation of the coefficient of correlation, 
are shown in the following tabulation: 



Grades 


Ages 








(Sub.) 


(RcL) 


Sub.« 


Rel.« 


SXR 


1 




6 


1 


36 
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1 
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36 


6 


1 
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49 


7 


2 
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4 


49 


14 


2 
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4 


64 


16 


2 




9 


4 


81 


18 


3 




8 


9 


64 


24 


3 




10 


9 


100 


30 


4 




9 


16 


81 


36 


5 




10 


25 


100 


50 


Total 24 




80 


74 


660 


207 


Average 2.4 


8 










80 X 2.4= 


-192 








24 X 2.4= 


- 57.6 








80 X 8.0> 


-640 








207 


-192- 


15 








74 


-57.6= 


»17.4 






{ 


660 


-640- 


20 







15 15 15 ^^^ 
; -0.80 



>^17.4 X 20 ^348 18.65 

In this example the coefficient of correlation is equal to the 

fraction — . The numerator (15) is derived from the 

1^17.4X20 
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products of the items of the two series. The denominator is equal 
to the square root of the product of two numbers, which are 17.4 
and 20. The first of these two numbers is derived from the sub- 
ject series, giving the data for grades, and the second from the 
relative series, giving the data for ages. 
The coefficients of regression are derived from this fraction and 

are and — The first has as its denominator the number 

17.4 20 

17.4, which was derived from the data as to grades. The co- 
efficient of regression tells the amount of change in ages 

taking place on the average in this group for a change of one in the 
grades. This information does not in this particular case give us 
information of much value. 

The other coefficient of regression is the fraction — in 

20 



which the denominator was derived from the data on ages. 

coefficient tells us how much the children in this group go forward 

in the grades on the average for each advancing year of age. It 

15 3 

tells us that they go forward — or — of a grade for each year 

of age. This is in accord with the original conditions of the prob- 
lem, for it was stated that half the children made 100 percent of 
normal progress and the other half 50 percent, or an average of 
75 percent of the fuD rate. 

This is information of an important type that cannot be secured 
by the simpler processes of working directly with the averages of 
the series and trying to compute the relationship between the 
time the children have been in school and the progress they have 
made. In many sorts of results from tests of classroom work the 
coefficients of regression can be used to great advantage. 

The method described for finding these coefficients is far simpler 
than the one usually used. The formula commonly given (rho 

standing for the coefficient of regression) is p=^r—' 

The steps by which the method here described was derived from 
the standard formula may be readily followed through by anyone 
familiar with the ordinary notations for the coefficient of correla- 
tion. They are as follows: 
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w 



^fX 



2*7 



The application of the method described may be again Illus- 
trated by u^ng as an example an age and grade table. The one 
chosen is a supposititious distribution for a system where 160 
children enter each year at the age of six. They are promoted 
annually at a 75 percent rate and none drop out. The data for 
the table, together with the computations of the coefficients 
of correlation and regression, are shown in the accompanying 
tabulation. 
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1,280 


4,642 21,446 






















av. of sub. itemi 


RT 
RRT 

2S 


960 

5,760 

160 


1,120 
7,840 
280 


1,280 

10,240 

4O0 


1,440 

12,M0 

S21 


1,600 

16,000 
641 


1,760 
19,360 

760 


1,920 

23.040 
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2,080 
27,040 
1000 


12,160 
122,240 


IV. of nl. itemi 


R(SSf) 


960 


1,960 


3,200 


4,689 


6,410 


8,360 


10,560 


13,000 


49,139 


1,280 " 
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4,6i2X9^«44,099 
4,642X3.627^16336 
12,160X9^« 115^20 

49,139- 44,099^5,040 

21,446- 16,S36-4,610 

122,240-115,520=6,720 

5.040 5,040 5,040 ^_ 

v^4,610 X 6,720 1^30,979,200 5,566 
Pi-l.OQ p,»0.75 

In this case the coeffident of correlatioii is 0.91. Such co- 
efficients based on age and grade tables are always high and there 
is surprisingly small range between those for relatively efficient 
school systems, having little retardation and those for far less 
effective systems showing high percentages of retardation. 

The coefficients of regression are of greater interest and more 
value. In this case the coefficient of regression based on the grades 
is 1 . 09. This indicates that in this school system the children 
tend to average 1 . 09 increase in years of age for each advance of 
one grade. 

The other coefficient in this case gives us more valuable infor- 
mation. It is 0. 75 and is based on the ages. It tells us that the 
children in this system tend to go forward on the average three- 
fourths of a grade for each advance of one year in age. This is in 
agreement with the conditions laid down at the outset which were 
that these children were regularly promoted at a 75 percent rate. 

Coefficients of regression can be made to yield information of 
great practical value. They may well be used in studying such 
questions as: regularity of attendance and promotion rates, defi- 
ciency in weight and hemoglobin counts, progress through the 
grades and expenditures for supervision, pages of material read 
in the first three grades and ability in silent reading, time spent 
on spelling drills and scores in spelling ability, years of schooling 
and earnings up to the age of fifty, and many others of the most 
varied character. 



REVISING THE COURSE OF STUDY 

In the voluminous discussion of the reconstruction of the cur- 
riculum during the past year nothing is said about the cost. It is 
assimied that if the superintendent and teachers decide upon a 
revision, the staff will perform the task in their leisure time. But 
such an assumption is entirely erroneous. A new course of study 
can be prepared by the staff but a thorough-going revision involves 
too much detail work of a clerical, time-consuming sort for any 
staff to be able to perform it in their free time. To discover the 
common errors in language in a school system as a basis for a 
language curriculimi requires anywhere from two hxmdred to five 
htmdred hours of clerical work, which is the full time of one person 
for at least a month of eight-hour days ; and this does not include 
the time of the supervisor of the study who formulates the plans 
and writes the report. To discover what mathematics is needed 
as a preparation for the study of one textbook in chemistry involves 
fifty hours of clerical work in addition to forty hours devoted to the 
study by the supervisor. To collect practical problems and proj- 
ects to supplement the teaching of physiology and hygiene, 
arrange the necessary material, and prepare it for classroom use 
involves the expenditure of fifty hours each for three persons. And 
all of these are fragmentary studies. 

It is quite as reasonable to expect the manual arts department 
to build the school buildings without assistance as to expect the 
staff to revise the course of study in their free time. Bricks can- 
not be handled as rapidly as ideas but there are more ideas in the 
course of study than bricks in a building and it takes time to han- 
dle ideas. The task of the revision of what children are taught is 
immeasurably more important than the construction of buildings 
and the difficulties are much more complex and quite as time- 
consuming if the work is thoroughly done. 

It is, therefore, necessary for boards of education who authorize 
a revision of the course of study to provide funds to make it 
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poaable for certain teadms to be nfieved of put of their duties, 
to engage clerical afwastanfr, to croflay e np e its on trrhniral 
phases of the problem^ and to make the necessarv studies in the 
research dqMUtmenL It is becoming increasinglj necessary for 
state d^MutmentSy the federal bnrean oi education, and other 
large educational units to establish the cnrricolnm as one of the 
major projects of investigation with a staff soflkiently large to 
make revision more than a makeshift. The deadweight of the 
load is much greater than administrators have generally realized. 
The woriL cannot be done by discussion and argument. Detailed 
studies are necessary and details cost money. 

SCIEXTIFIC CURRICULUM BUILDIKG 

Scientific curriculum buflding involves a danger of iddch the 
curriculum makers do not appear to be aware. The method as 
frequently practised consists in finding out what elements of 
school subjects are in frequent use and incorporating these 
elements into the subject matter to be taught. Analysis reveals, for 
example, that adults make almost no use of fractions or dedmak; 
that periodicals and newspapers contain surprisingly few histori- 
cal or geographic allusions; and that the fundamental vocabulary 
of business and personal correspondence is astonishingly smalL 

Sometimes the analyst reaches the conclusion, expressed or 
tacit, that the curriculum should contain no more than these mea- 
ger elements which he has found to be in frequent use. More 
often, however, it is those who use his results who reach this 
conclusion. This, we maintain, is not a correct inference. The 
only correct inference — and it is the inference of the more careful 
workers — is that, no matter what else is included, the elements 
thus found to be socially useful shall certainly form part of the 
curriculum; in other words, that they shall constitute a part of the 
''minimum essentials" of the subject to which they belong. 

The bearing of analyses of social needs upon the oirriculum may 
be most completely illustrated with reference to spelling. This 
is true not only because the social value of spelling is obvious but 
also because more analyses have been made of spelling usage than 
of any other. The principles, however, which we shall suggest 
have a general application to all the subjects which have been 
similarly studied. 
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In the first place, we cannot by any means be sure that the 
present determination of frequency of use is the true one. For 
example, in the list which purports to consist of the thousand 
commonest words, we do not find the names of our daily meals — 
neither breakfast nor lunch, dinner nor supper. Nor do we find 
the commonest articles of tableware, such as plaU, cup, knifes 
fork, and spoon. Many articles of food — potatoes, beans, beets, 
peas, meat, fish, bread, and butter — are not named; nor are some of 
the commonest articles of clothing nor some of the most familiar 
colors. Only the horse is mentioned among domestic animals. 
The dog and the cat, the cow and the sheep find no place in the 
list. 

One may contend that these may indeed be common words 
without being frequently used in written discourse. The conten- 
tion, however, has little plausibility. A child cannot write of hia 
play without using such words as hide, jump, swim, fish, or sled, 
and these words are omitted from the thousand most frequently 
used. He can scarcely write of the barnyard without requiring 
such omitted words as hen and egg; he caimot write about his 
garden nor the baby at home; nor about the moon, the sun, the sky 
nor the stars. Yet these are the things within his experience. 
They are, therefore, the sort of topics which we should expect him 
to write about. 

On the other hand^ among the ''thousand commonest words" 
are found these: preliminary, recommend, impossible, assure, com- 
mittee, investigate, national; and a number of terms of apparently 
legal meaning such as property, judgment, testimony, complaint, 
agreement, witness, and conviction. This suggests that the source 
of our vocabulary studies must be very greatly widened and that 
an enormously greater amount of written material must be 
examined. 

In the second place, even if true frequency of use has been 
determined, we assert that there are other tests of value than 
frequency of use. For example, although the word bread may be 
rightly excluded from the thousand commonest words; yet cir- 
cumstances which, while they may be relatively infrequent are 
nevertheless inevitable, will certainly make it at times indispen- 
sable in one's written vocabulary. Future research may con- 
ceivably confirm the present determination that apple and batuina, 
bright and beautiful, meat and drink, likewise do not belong to the 
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thotisand commonest words. But this is not a suffideat reason why 
they should be banished from our spelling curriculum. These 
are simple words and they stand for ideas common to the race. 
The ideas may not require expression quite often enough to secure 
for the words a place among those used with an assigned frequency; 
but when these ideas do require expression — and no one can escape 
the necessity for such expression — they become as "socially 
useful" as do their more frequently used competitors. 

In the third place, in selecting material for the school curricu- 
lum, difficulty as well as frequency of use is a criterion. Indeed 
to a certain extent there is an inverse relationship between diffi- 
culty and frequency of use. Some elements of school subjects, 
precisely because they are frequently used, and hence often re- 
peated, do not need to be taught at all. Such is the case, for 
example, with most of the two and three letter words in our 
language. No one who is in the least degree literate misspells and 
except by inadvertency — and correcting inadvertency is not a 
spelling problem. Some of the recent spellers in their attempts to 
adhere to the vocabulary studies have included a considerable 
group of words which do not constitute a spelling problem. 

In the fourth place, whether with reference to spelling or any 
other subject of the curriculum, whatever the much-discussed 
aim of education may be it contemplates something more than the 
round of common experiences, something richer than the elemen- 
tal facts of life. ''A man's reach should exceed his grasp''; and it 
is only by providing for more than is now generally available that 
progress is possible. Here as elsewhere in the application of 
scientific procedure to education, a sound philosophy — as well as 
a soxmd common sense — ^must be invoked to save the scientific 
procedure from itself. 

Four points may, therefore, be made with reference to the suffi- 
ciency of the idea of frequency of use. The first is that material 
far greater in amotmt and variety will have to be examined before 
we can be sure that frequency of use has been determined. The 
second is that certain material of relatively low frequency of 
occurrence has a social usefulness which renders it indispensable. 
The third is that difficulty, or need of being taught, is an important 
criterion — one which operates in particular to reject from the 
formal curriculiun an appreciable amount of frequently used 
material. The fourth is that if we include in our curriculum only 
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the materials which are found to be frequently used by children 
and adults we leave altogether out of account the material which 
they ought to use and would use if their lives were fuller and 
richer. This fullness and richness, we feel quite sure, the school 
must envisage. Moreover, to adjust the curriculum merely to 
current usage is to doom our educational system to a static con- 
dition wherein progress becomes impossible. 

S. R.. S. 




Virginia Education Commission. Virginia public schools. (Including the lepott 

of the Survey Staff.) Richmond, Va.: Everett Waddey Co., 1919. 400 pp. 

Very businesslike is this report. Its precision of aim gives it a certainjdirectness 
and point which is often lacking in surveys whose object is merely to find out some- 
thing. Moreover, the survey is peculiar in other respects. In the ,*fir8t place, it is a 
state survey and, while the system is not among the largest, it is by no means smalL 
In the second place, considering the bigness of the imdertaking and the wide range of 
topics discussed, the survey report is brief — ^brief in a day when brevity of reporting 
is by no means common. In the third place, being a state report, its findings work 
over inevitably into recommended legislation, i.e., into provisions for specific improve- 
ments. In the fourth place, there b an entire absence of either animus or the effort 
to "get" somebody. 

Despite the brevity of the report, an abstract of it would be too extensive. More- 
over, the book, we are told, will be published shortly by a commercial house and will, 
therefore, be easily available. We feel inclined strongly to recommend it to students, 
nor should we be greatly surprised if professors of education shouldjfind parts of it — 
especially the financial parts — useful as required reading. ,^|.l4.^^ -^^^ 

As an example of a good method in reporting, it seems to us that the book la 
distinctive. The main body of tabular material is thrown into the back of the volume; 
this device adds to the readability of the report We beg, however, to suggest an 
added improvement, namely, that the reading matter should be complete in itself; in 
other words, that the reader should be conscious of no loss of essential detail Thus, 
the text should not directly require the reader to consult the tables. It should form a 
consecutive whole, and the references to tables, like bibliographical^dtations, should 
be carried in footnotes. 

The legal status of schools in Virginia is peculiar in that the constitution, instead 
of confining itself to general provisions, embodies many details. Accordingly, many 
of the survey recommendations require constitutional amendments. Some of these 
amendments were proposed by the 1918 assembly; others will have to come up for the 
first time this year. They must then be passed again in 1922 and submitted to the 
people. 
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Some of the important recommendations of the commission to the General Asscoi- 
bly — ^recommendations in abnost complete agreement with the corresponding recom- 
mendations of the survey staff to the conmiission — are as follows: (1) that the state 
board of education be appointed by the governor, and that it select the state superin- 
tendent at large; (2) that division superintendents be elected by local school boards 
from a list of eligibles prepared by the state board of educatum; (3) that the district 
unit be abolished in favor of the county (city or town) unit; (4) that the state school 
fund be distributed as follows: an amount not to exceed 5 percent to be used as a 
special relief fund ; of the remainder, one-third to be distributed on average or aggregate 
attendance, one-third on the number of teachers employed, and one-third according to 
the adequacy of the local support; (5) that an effective compulsory education law and 
a school term of nine months be provided; (6) that assessments be increased and equal- 
ized and the constitutional tax limit removed, the limit to be determined by the legis- 
lature; (7) that free textbooks be provided at state expense; (8) that teachers' «alap»« 
be increased and based on minimum professional qualifications, the state tax being 
increased from fourteen to twenty cents to provide a part of the necessary funds; 
(9) that, as to teacher-training, normal schoob abolish high-school courses, train only 
elementary school teachers, and extend the professional course from two to three years; 
that training departments in high schools be abandoned; that state institutions of hi^ier 
learning be operated all the year round on the four-quarter basis, with special provision 
by means of two six-week terms in the summer for public school teachers; (10) that 
vocational education, physical training and school hygiene, education of negroes, and 
thee onsolidation and improvement of rural schools be definitely organized. 

The survey has not failed to provide for adequate financial support for the public 
school system as it would be constituted if these recommendations were enacted into 
law. We should not know where to turn to find a clearer statement of how to deter- 
mine and provide the amount of money needed to operate a good school system. 

The (General Assembly of 1918 had appropriated $10,0(X) for the survey conmiis- 
sion. Later it seemed advisable to create a division of tests and measurements. It 
was evident, however, that, in order to do anything at all adequate in applying educa- 
tional and psychological tests throughout the state, a great deal more money would 
be needed than the survey had in hand. Fortunately, the General Education Board 
was induced to appropriate $12,500 for this purpose. 

Accordingly, for the first time in a state survey an attempt was made to ascertain 
the character of the work of the schools by means of actual standardized tests. 

The chapter devoted to the work of this division is entitled: "The Results of 
Instruction Measured." It is wholly inadequate; and the propriety of including it in 
the survey volume is doubtful, especially since a special report on this phase of the 
survey work is promised for later publication. We observe the rather curious, not 
to say crotchety, selection of tests. This display of originality, however, led to at least 
one fortunate result, namely, the inclusion of two intelligence tests in the list. Thb 
is the first large use in a survey of such tests. The results of these tests, if, in the forth- 
coming publication, they are properly related to the educational tests, will constitute 
an important improvement upon conventional methods of reporting. 

It seems to us that the work of the Division of Tests and Measurements forms no 
integral part of the survey which the Assembly had in mind when it created the 
commission. The problem was distinctly a legislative one. What Virginia needs more 
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tlian anything else is permission to go ahead and mandatory laws which will cut away 
old prejudices. The decision to test the schools may have been a wise one from another 
point of view, but it seems to us to constitute an almost entirely separate project. 

As to the rest of the report, it is, as we have intimated, unusually effective. It 
"gets across." Unless we are much mistaken, a large proportion of the commission's 
program will be enacted into law — this, of course, unless politics play an unusually 
powerful r61e. The price of $10,000 may weU prove infinitesimal compared with the 
advantages. 

B. R« B. 

Manuel, He&schel T. TalerU in drawing, (School and Home Education Monographs, 
No. 3.) Bloomington, Illinois: Public School Publishing Company, 1919. 152 pp. 
This monograph reports a study of gifted children made in 1916-1917. It was 
subsidized by the General Education Board and was conducted under the direction of 
Professor G. M. Whipple. In this study two groups of important related problems 
were recognized, namdy (1) those pertaining to pupils of high general ability, and 
(2) those pertaining to pupils of special ability. Dr. Manuel's book has to do with 
the second group of problems. Its scope is indicated by its subtitle: "An experimental 
study of the use of tests to discover special ability." Pupils of special ability are 
defined as those who "by endowment or by training are so equipped as to take special 
interest in, and to succeed eztraordinarly weU with, some one ability." 

The present study proposes to consider a special ability (drawing) with reference 
to two problems: 

1. What are the essential ps3rchophysical characteristics of persons possessing 
talent in drawing? 

2. How may the test method be used in the diagnosis of such talent? 

Forty-five individual tests, mental and physical, which were more or less stand- 
ardized, were used with nineteen subjects chosen for recognized talent in drawing. The 
subjects were distributed as follows: college or university, 5; secondary school, 8; 
elementary school, 6. Biographical and personal data were also collected. The 
test results are presented by means of the "psychograph" or "profile" showing graphi- 
cally the performances of each subject in several tests as compared with standard 
performances. This method of representing the statistical data derived from psy- 
chological tests is especially useful for diagnostic purposes. 

As to the first problem — ^the characteristics of those talented in drawing — the 
following abilities seem closely related to ability in drawing: MentaUy to note a visual 
form and to reproduce it; to observe; to select from a complex visual situation the most 
representative and the most beautiful aspects; to remember visual forms; to manipu- 
late them mentally; to control hand movements in accordance with visual percept or 
image; to invent — i.e., to bring together into new artistic combinations the elements 
of different visual experiences; to judge the beautiful in line, form, color, and composi- 
tion; and to discriminate differences in color and in visual magnitude. Acuity of vision, 
interest in the act and products of drawing, and general intelligence are likewise 
characteristics of those talented in drawing. 

As to the second problem — the diagnosis of talent in drawing — ^naturally tests 
of the foregoing abilities are the ones selected from the entire forty-five as having 
highest diagnostic value. These are described and references are given indicating 
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where they may be found. It is recommended that tests be arranged to ascertain 
not only the strength of an ability but also its improvability. The so-called "in- 
structed-leaming" method is therefore advised. Finally, the author notes that "the 
measurement of many different abilities not primarily related to drawing is necessary 
to the most effective educational and vocational use of measurement of ability m 
drawing." 

While it has not been the purpose of the author in this study to prepare material 
and standards for the recommended tests, he promises a further contribution of this 
nature. His limitations due to lack of standards is evident throughout, but we trust 
the onp who has made so thorough an investigation of this particular problem will 
shortly supply the supervisor and teacher of drawing with usable tests valuable in 
determining the particular talent. 

J. OSIN POWKRS 

MuBDOCH, Katharine. The measurement of certain elements of hand sewing. (Teach- 
ers College Contributions to Education, No. 103.) New York: Teachers College, 
Columbia University, 1919. 120 pp. 
The scope of this monograph is well described by the following statement of the 

author: 

"The specific tasks of this research are as follows: 

1. To make a scale by means of which merit in certain forms of hand sewing 
may be measured. 

2. To make an inventory and analysis of the faults found in children's 
sewing. 

3. To determine the relative importance of various faults and of various 
stitches as indicators of general merit in sewing. 

4. To determine the relative reliability of judgments concerning various 
faults and concerning various stitches. 

5. To determine (a) the reliability of one or more samples of a child's sewing 
in evaluating her real ability in that kind of sewing; to determine (b) the number 
of samples of various stitches which would be required in order to have various 
degrees of probability that a child's real ability to execute that particular stitch 
was measured. 

6. To determine the relative accuracy of competent persons, with varying 
degrees of knowledge about sewing and the teaching of sewing, as judges of sewing 
products. 

7. To test the value of our sewing scale as a means of attaining greater exac- 
titude in the grading of sewing products." 

As a preliminary step in constructing the scale for measuring certain elements of 
hand sewing, samples of the hand sewing of 1,212 individuals were secured. These 
samples are called samplers. They were uniform as to material and kinds of stitches. 
In quality they ranged from the samplers contributed by 37 children who were in 
special classes for defectives or in institutions for the feeble-minded to samplers 
contributed by adults who were judged to be expert hand sewers. From these samples 
of hand sewing 15 samplers were finally selected, which, on the basis of the judgments 
of competent judges, range in quality from to 16.4. The method of sdection and of 
determining the scale values follows closely that originally used by Thomdike in the 
field of handwriting and drawing. Each unit "represents that amoimt of merit which 
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exists between the samplers when one is recognized as being of more value than the 
other by 75 per cent of competent judges and of less value than by the other 25 per 
cent of the judges." "Zero was arbitrarily defined as meaning the score to be given a 
sampler which could be recognized as an atten^t to conform to the directions for the 
maldng of the sampler, but which had absolutely no merit as an example of the stitches 
indicated." On the basis of this definition of zero, 38 of the 80 judges said that the 
sampler finally chosen to represent zero, represented zero, 21 judges considered it 
better than zero, and 21 judges considered it worse than zero. This sampler was 
contributed by an imbecile boy "untrained in sewing who b particularly deficient in 
motor control and who suffers from serious eye trouble which often causes dizziness 
and nausea." 

Each of the samplers contains five kinds of stitches: combination, running, over- 
casting, hemming, and backstitch. Half-tone reproductions have been made of the 
fifteen samplers chosen for the final scale. Three views are given of each sampler in 
such a way that all of the sewing is represented. Thus the final scale as made a^^dlable 
for general use consists of half-tone reproductions of the fifteen samplers made in such 
a way that all of the sewing is clearly shown. 

The construction of the scale was supplemented by the analysis of the faults in 
the stitches involved in these samples of hand sewing. The list of faults was finally 
reduced to 23 in number and the relation of these to general merit was studied. This 
work supplements the scale in a very significant way. It is particularly valuable in 
Mi^Utiwg in the interpretation of measures in terms of the pupil needs. 

In the study of the reliability of the measures yielded by the scale there are two 
significant findings. When it was used to measure the quality of the hand sewing 
in completed articles such as aprons and bags, it was found that the measures assigned 
by different judges were less variable than when isolated hand sewing on samplers 
similar to those of which the scale was made was measured. This finding shows that 
it is feasible to use the scale in measuring the hand sewing done in making real things. 
The second finding was that judgments of different teachers, based upon the use of 
the scale, were foimd to be less variable and hence more accurate than judgments 
made without the scale, although only teachers from a single large high school were 
used in this experiment and were untrained in the use of the scale. 

The most significant features of Miss Murdoch's work are the ways in which she 
has supplemented the usual scale derivation. The time is rapidly approaching, if 
it has not already arrived, when new measuring instruments will receive little con- 
sideration until scientific evidence concerning their usefulness is made available. 
Already it is being urged by some that each measuring instrument should be accom- 
panied by a definite statement concerning its reliability and validity. Miss Murdoch 
is one of the first, if not the first, to accompany the account of the derivation of a 
scale with a statement of the reliability of the scores that are obtained by using it. 
Furthermore, as stated above she demonstrates that the scale can be successfully 
used in judging the hand sewing on completed articles of a rather complex nature. 

The scale has yet to be standardized and there is not contained in the monograph 
sufficient directions to guide a teacher in using it. It is to be hoped that in making 
the scale itself available to teachers, detailed directions for using it as well as record 
sheets for the tabulating of the results will be provided. 

W. S. M. 
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Hekry, Theodore S. Classroom problems in the education of gifted children. (Nine- 
teenth Yearbook of the National Society for the Study of Education.) Blooming- 
ton, Illinois: Public School Publishing Co., 1920. 125 pp. 

For a long time there has been in this country some recognition of the necessity 
of meeting the needs of pupils of marked ability in such a way as to give them oppor- 
tunity for more rapid advancement than that of the average pupiL The great and 
hitherto unsuspected individual differences revealed by the recent widespread applica- 
tion of mental and educational tests are fast pushing this subject to the forefront of 
attention. 

In this monograph the National Society for the Study of Education has once 
more made an important and timely contribution to the science of education. The 
study is the report of the results of an experiment in which pupils selected on the 
basis of their excellence in school work were placed under special instruction. It 
includes a summary of the various schemes for flexible promotion which have been 
tried out in this country, and a description of the types of special classes that have 
been established for gifted pupils. In addition, there is a chapter on the methods of 
teaching which are especially adapted to the instruction of this class of children, and 
a bibliography covering the general field. 

The number of pupils selected for the experiment which was carried out in one 
of the public schools of Urbana, Illinois, was thirty^ — ^fifteen from the fifth and fifteen 
from the sixth grade. The attempt was made to carry out the experiment under 
average conditions of schoolroom instruction. "Supervision, course of study, physical 
equipment of room and of building, instruction — none of these could be said to be 
above average." The remaining fifth- and sixth-grade pupils of the school were used 
throughout the experiment as a control group. The intelligence quotients of the 
members of the special school as measured by the Terman revision of the Binet-Simon 
Scale ranged from 99.3 to 146.6. It appears, therefore, that on the basis of these 
tests there were pupils in the special class who did not belong there. Indeed, if the 
author's recommendation were adopted that a minimal I. Q. of 115 be the standard 
for admission to such special classes, it would rule out fourteen of the thirty pupOs 
of this special class. Notwithstanding this handicap the special class was able to do 
the work of two grades in one year, and seventeen pupils secured corresponding pro- 
motion at the end of the school year on the basis of the regular examinations. Almost 
all of the remaining pupils passed special examinations after review woric during the 
summer and thus secured promotion. Educational tests given throughout the year 
showed that by May first the pupils had actually gained a year as measured by these 
scales. 

The interpretation of the results of such an experiment is necessarily somewhat 
difficult. There is no way of determining to what extent the more rapid progress of 
these pupils is due to the special conditions imder which they were placed rather than 
to their superior abilities. As the author points out, practically all the methods 
adapted to the instruction of the specially gifted are equally applicable in the teaching 
of the average pupil. It is difficult to say how much more rapid the advancement 
of the control group might have been if it had had the advantage of the same special 
attention, and especially if the same spur to ambition had been provided. The success 
of a large number of pupils of only average intelligence in gaining promotion seems to 
show that these factors were more important than the author believes. 

Edwasd H. Caiceron 
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This department will contain news items regarding research woricers 
and their activities. It will also serve as a clearing house for more formal 
communications on similar topics, preferably of not more than five hundred 
words. These communications will be printed over the signattu^s of the 
authors. Address all correspondence concerning this department to Walter 
S. Monroe, University of Illmois, Urbana, Illinois. 



One of the latest additions to the rapidly increasing group of 
West Virginia state educational institutions which have established a bureau 
University Bureau of educational research is West Virginia University. In a recent 
of Educational circular they announce the establishment of the bureau and give 
Research the prices of a number of educational tests and the addresses from 

which they can be obtained. 

In 1917 Dr. Albert Shiels, then superintendent of schools, recommended the 
establishment of two new departments. Accordingly a Division of Educational Re- 
Department of search was established in charge of Mr. Robert H. Lane, who 
Psychology and as a princii>al of one of the elementary schools had attracted 
Educational Re- attention. Also, a Division of Psychology was created and 
search at Los Dr. A. H. Sutherland was invited to begin some studies on 
Angeles, California types of children. In 1920 Mr. Robert H. Lane was elevated 

to an assistant superintendency and thereby rewarded for 
meritorious service. 

During the past two years comments have not been lacking that the work of the 
divisions overlaps. It was therefore decided to bring the two divisions together under 
the temporary name of the Department of Psychology and Educational Research 
with Dr. A. H. Sutherland as director. The new department is to continue the func- 
tions previously served by both divisions. It will have charge of the giving and 
training teachers to give standardized educational tests and the collection and tabula- 
tion of statistical information. It will also have charge of the segregation of types of 
children and the direction of the special rooms for backward children. 

Mr. H. C. Daley, Survey Department, Highland Park, Michigan, sends the 
following tabulation of the results of giving Monroe's Standardized Silent Reading 
An Experiment Test in the seventh and eighth grades. Form 3 was given on Sep- 
in Silent tember 19, 1919, and Form 2 on January 28, 1920. ''After the 

Reading September testing pupils were reclassified into strong and weak 

sections in accordance with the results of the tests. In several cases 
capable pupils were transferred to a higher grade." This shifting would tend to reduce 
the standing of the groups. In spite of this, all groups show remarkable gains. 

This use of two different forms of this test raises the question of the equivalence 
of the forms. Although the different forms were constructed so that they would yield 
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equivalent comprehension scores, a recent study of the different forms shows that this 
was not accomplished in all cases. However, the best data available at this time 
indicate that Forms 2 and 3 are equivalent for comprehension in the seventh and 
eighth grades. They are not equivalent with respect to rate. The rate scores on Form 
2 may be expected to be fifteen to twenty words higher than on Form 3. Thus the 
non-equivalence of the two forms used probably accoimts for a portion of the gain in 
rate but it does not accoimt for any of the gain in comprehension. 
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The twenty-eighth annual meeting of the American Psychological Association, 
held at Harvard University, December 29, 30, and 31, 1919 was attended by more 

than 150 workers in psychology and allied fields. Joint sessions were 
American held with the American Anthropological Association and the Amer- 

Psychological ican Association of Clinical Psychologists and provisions were made 
Assodation for inspection of the Massachusetts State School for Feeble-Minded, 

the Judge Baker Foundation, the Carnegie Nutrition Laboratory, 
McLean Hospital, the Psychopathic Hospital and other local institutions. 

Shepherd I. Franz, Government Hospital for the Insane, Washington, D. C, was 
elected president of the Association for 1920; H. S. Langfeld, Harvard University, 
and W. V. Bingham, Carnegie Institute of Technology, were elected to the council. 
Chicago was elected for the convention in December, 1920. Twenty-seven new mem- 
bers were voted into the association and the deaths, during the year, of John Wallace 
Baird, Edward Cowles, and August Hoch were reported. 

A committee consisting of Bird T. Baldwin, University of Iowa (Chairman); 
W. F. Dearborn, Harvard University; L. S. Hollingworth, Teachers College; B. Ruml, 
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The Scott Co., Philadelphia; and Helen T. Wooley, Vocational Bureau, Public Schools, 
Cincinnati, Ohio, were appointed to consider the legal and professional status of 
"clinical psychologists/' The N.E.A. at its last meeting passed a resolution to the 
effect that the diagnosis and segregation of defective children should be in the hands of 
highly trained and certified psychologists only; a similar resolution being adopted by 
the Educational Conference held at Albany, N. Y., in May 1919. The committee 
listed above is now engaged in (1) determining the qualifications of a clinical psy- 
chologbt and in suggesting means of establishing and promoting an adequate profes- 
sional curriculum; (2) investigating the methods of legal certification now operating 
in the states; (3) compiling data on the legal aspects of clinical work — the acceptance 
of testimony of a psychologist in court, commitments, etc.; (4) drawing up plans 
whereby the American Psychological Association may issue certificates to "clinical 
psychologists" and (5) determining the qualifications for psychological workers in 
industry. 

The program of the session gave 6 titles under general psychology, experimental 
psychology 16, intelligence tests, educational and clinical psychology 21, comparative 
psychology 2, social and religious psychology 3, and applied psychology 7. The pro- 
nounced development of the technic of trade testing, the thorough tryout of intelligence 
tests by their use on more than a million and a half recruits, bringing up the question 
of revision of older notions of median mental levels of unselected as well as psycho- 
neurotic, foreign-bom, colored and other individuals, the need of tests other than those 
of general intelligence for diagnosis of psychoneurotics, vocational aptitudes and re- 
tardation in schools, the need of systematic training and classification of workers in 
the rapidly growing field of clinical psychology and the use of individual and group 
tests in diagnosis and prognosis of ability in school functions, may be considered the 
main features of the meetings. 

The papers were so numerous and so varied in content, that no attempt will be 
made here to allude more than briefly to those which bear closely upon educational' 
topics. 

The address of the retiring president, Walter Dill Scott, Northwestern University, 
on the topic "Changes in Some of Our Conceptions and Practises in Personnel" gave a 
survey of progress in educational theory and practice. Evolution along five lines was 
emphasized: (1) A history was given of changes in the concept of the amount and 
nature of individual differences from the older belief that peoples were originally 
much alike and that such differences as appeared were due to environmental factors 
to the present belief that individuals differ enormously in all traits and that such 
differences are largely innate. "The greatest achievement of the association has been 
the establishment of the fact of individual differences and its applications to educa- 
tion, politics, industry, and economics." 

(2) The importance of reasoning as a factor in adjustments has been superseded 
by the consideration of instincts, emotions, and habits. The operation of instinctive 
trends as the spring of action and the sources of discontent in industrial life was 
illustrated by concrete cases. It is not the violation of the worker's logical processes 
that brings imrest and discontent so much as thwartings of his pride, his desire of social 
approval, of mastery, and his instinctive and emotional trends. 

(3) Education in the schools or in the factory must take into accoimt the imleamed 
forms of reaction to features of the environment and seek to so order the individual 
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and his environment that the desirable adjustments may be made. The woHl of the 
personal director in industry must be enlarged and his function must be that of pro- 
viding the approved experiences so that desirable habits of response will be buUt up. 
Mere richness of content or training of general faculties will not suffice. 

(4) Changes have taken place in the concept of man and his environment. A man 
b not the victim of his environment, he is not the master of it nor is his function that 
of subduing or opposing it. The two should evolve together. In industry, the man 
and his job are not opposed, nor does the concept of selecting the man to fit the job — 
finding a square peg for a square hole — adequately express the present point of view. 
The function of the personnel manager is the "creation of the worker in a woiking 
situation.'' The work must be arranged to satisfy the human wants of the woricer 
and he should be set to the task most in harmony with his particular talents and 
interests. There must be a correlated improvement of the work and the workers. 

(5) The last point led to a survey of the evolution of vocational guidance from 
the chance methods of superstition, guess, and incidental inclinations to the modem 
technic to mental, physical, and vocational tests, statistical methods and the like. 
"In the last century the productivity of the worker has been doubled by the activities 
of some 2,000 minds through changes in the material world. In the present century 
equally great increases in productivity may be expected through the adjustment of 
worker to the work." 

Following are brief summaries of papers, presented in the various sessions, which 
may be of interest to workers in education. 

A most valuable and practical method of evaluating school attainments in terms 
of mental ability is the result of studies by Rudolf Pintner of Ohio State University. 
A mental test alone is not sufficient to diagnose a child accurately; measures of school 
attainment based on both age and grade norms are needed. Two survey tests, one 
mental and one educational, were devised and applied to 1,500 cases. Percentile 
values are converted into a so-called "index" ranging from zero to one himdred. 
The median indices serve as a measure for the school. A high mental age with low 
educational index indicates deficiencies in instruction, whereas a dose agreement 
between the two indices indicates efficiency in the school In the same way different 
classes in the same school or different individuals in the same class may be compared, 
enabling one to correlate innate ability with possible attainment and to apply correc- 
tive measures when the need appears. 

£. A. Doll, Princeton University, presented data obtained from intelligence 
tests of a million and a half army recruits and other subjects bearing upon the median 
mental age of adults, commonly assumed to be about 16 years for unselected groups. 
The Stanford-Binet median mental age equivalent of army recruits is 13 years; of 
negro and foreign-bom recmits 10 years; of adult male state prisoners 13 years, the 
actual tests used in each case being the Army Alpha. Five himdred typical public 
school children examined by Alpha show no increase in median scores by age after 13, 
the same being true of juvenile delinquents, ages 16 to 30 years. From these data 
the suggestion was made that the median mental age level of native white adults is 
approximately 13 years. No attempt was made to determine the life age limit of 
mental growth, since, it was suggested, "emotional development, skill, acquisition, 
aptitudes and the like probably continue to develop indefinitely." The upper age 
limit of feeblemindedness is not coincident with the lower mental age limit of nor- 
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nudity, since it appeared that the borderline zone for feeblemindedness may cover 
a range from mental age 7 to 13 years. The application of mental age or I. Q. as 
criterion of mental defect is specially limited in the case of individuals of 10 or more 
years chronological age. Data harmonizing with these results were presented by 
F. L. Wells of McLean Hospital. The median I. Q. (Stanford scale) of 102 cases 
of mental breakdown at McLean is 88 but I. Q.'s of 100 are frequent and I. Q.'s of 119 
have been found in patients conspicuously incapable of self-maintenance. Only in 
organic psychoses does the breakdown regularly involve the ideational capacities with 
which the intelligence scales are concerned. Normal and even superior '%telligence" 
is very generally associated with grave judgment and conduct disorder. Intelligence 
scales measure essentially ability to deal with ideas, as distinct from ability to deal 
with things or with people. Psychotic breakdowns are essentially failures of adjust- 
ment to the social environment. The speaker emphasized the minor r61e of "intelli- 
gence'' (ideational capacity) in mental balance, urging a conception of education as a 
discipline of character rather than knowledge. 

With a few changes, the Binet tests were successfully employed by S. P. Hayes, 
Mt. Holyoke College, in measuring the intelligence of the blind. A modification of the 
Pressey group tests also gave high correlations with the Binet scores and abilities 
estimated by teachers. £. L. Woods, Wisconsin State Department of Public Instruc- 
tion» reported on the use of the recently devised Virginia tests Alpha in group testing 
of intelligence of delinquent girls. J. B. Miner, Carnegie Institute of Technology, 
displayed a method of utilizing three-dimensional models for representing individual 
differences in complex abilities such as salesmanship. Certain relations not now taken 
care of in frequency tables, correlations, multiple regression, etc., can be displayed by 
such modeb. 

L. W. Webb, Northwestern University, foimd the Pearson coefficient of correla- 
tion between rate of reading (Monroe Standardized Silent Reading Test) and the 
Army Alpha and Thurstone Tests A and B ranging from -f-0.47 to -f-0.59; compre- 
hension of reading gave coefficients ranging from 4-0.48 to -f-0.69. Speed and com- 
prehension of reading correlate -f-0.85. The speaker contended that these correla- 
tions show too large a dependence of the pencil and paper tests upon rapidity of 
comprehension in reading. 

L. L. Thurstone, Carnegie Institute of Technology, found the cyde-omnibus 
form of intelligence test to be of great service in furnishing data for recommending 
candidates for admission to engineering colleges, in advising committees on scholarship 
in cases of delinquent students, and in giving vocational counsel. S. S. Colvin, of 
Brown Univei^ity, reported a correlation of -f-0.60 between success in the Brown 
Intelligence Tests and the standing in college for the first two years. The Thomdike 
tests, first used in 1919, proved to be of great prognostic value and showed a high 
correlation with itself in repeated tests on the same subjects. 

D. Mitchell, Pelman Institute, defined clinical psychology as a "professional prac- 
tice" as contrasted with the "science" of laboratory psychology. Clinical psychology 
was again contrasted with "applied psychology" largely on grounds that the latter 
field may have no relation to the individual. CUnical psychology is the practise of 
determining mental states in order to prescribe kinds and methods of education, of 
detecting specific abilities and disabilities of vocational significance and the manip- 
ulation of emotional development for desirable social reactions. Dr. Augusta F. 
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Bronner, Judge Baker Foundation, emphasizing the function of clinical psychology as 
that of individual diagnosis, gave illustrations of the failure of general intelligence 
tests to betray significant variations in mental equipment. The necessity of devising 
tests for many specific abilities was urged. Florence Mateer, Bureau of Juvenile 
Research, has found that whereas the mental age or I. Q. are of little value in the 
detection of psychopathic conditions due to syphilis, a detailed account of the range 
of plus and minus scores, and more precise measures of the individual responses often 
give a reliable due to either congenital or acquired syphilis. The same type of analysis 
generally differentiates the psychopathic from the non-psychopathic no matter what 
the mental age may be. 

Tests devised to measure such functions as persistence, conscientiousness, applica- 
tion and emotional control are being applied to junior high-school and other students 
by S. L. Pressey of Indiana University. Correlations of results from these tests with 
general intelligence, health, and estimates of intelligence were presented. Mrs. L. W. 
Pressey, Indiana University, urged group testing of general intelligence in the primary 
school as a means of studying the effect of school training upon tests subsequently 
given. Data pennitting comparisons of test findings on children of the laboring and 
professional classes, whites and negroes, etc., were presented. £. A. Kirkpatrick, 
Fitchburg State Normal School, believes that normal school pupils may be trained in 
fifteen hours to use the Binet tests in classifying pupils. Less time is required to 
handle group tests, but much more is needed to enable the student to score, tabulate 
and interpret the results. Daniel Starch, University of Wisconsin, found in data 
obtained from 1,000 first-year pupils, that approximately equal mental ability may 
exist with great differences in language ability. Correlations ranging from -f-0.25 
to 4-0.28 between interest in college subjects and grades received in them were found 
by J. W. Bridges, Ohio State University. The correlation between interest and the 
subject's estimate of his ability in the courses was higher -f-0.50 to 4-0.59. 

From data obtained in several extensive investigations cited by E. L. Thomdike, 
Teachers College, Colimibia University, it appears that even experienced judges can 
not treat an individual as a compound of separate qualities, such as intelligence, 
industry, technical skill, reliability, etc., and to assign a magnitude to each of these in 
independence of the others. The correlations between such traits are too high and 
too even, the ratings being apparently affected by a marked tendency to think of the 
person in general as rather good or rather inferior and to be influenced in all judgments 
by this general attitude. It was suggested that observers should report the evidence, not 
a rating, and that the ratings should be given on the evidence for each quality separately. 

E. G. Boring, of Clark University, offered several cautions concerning the uncriti- 
cal acceptance of the dbtribution of mental traits according to the normal probability 
curve. The form of the distribution depends, for one thing, upon the unit of measure- 
ment adopted. If the normal law, moreover, is the law of chance, then two mutually 
dependent variables for which the relationship is not simply linear, such as height and 
volume which varies roughly as its cube, cannot have the same form of chance distribu- 
tion. If the distribution for height is normal, the distribution for volume cannot 
possibly be. 

W. T. Shepherd, Washington, D. C, in a study of 14S children, ages eight to 
thirteen years, emphasized the importance of the educational and social experiences, 
the influence of respected teachers or friends upon the development of religious ideak. 
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The prevalent belief that our judgments in the fields of appreciation of music or 
literature as well as in morals are considerably influenced by the contrary opinions of 
the majority of experts in these fields is supported by experimental data obtained from 
college students by H. T. Moore of Dartmouth College. Comparisons with control 
groups yield results showing that the knowledge of contrary opinions of the expert or 
the majority produces reversals of individual opinions in matter of speech amounting 
to four or five times mere chance. Moral reversals under majority influence are 4 . 7 
times chance whereas reversals of musical preferences as a result of expert or majority 
opinion is about twice chance. 

Arthus I. Gates 
Teachers College, Columbia University 

The State Department of Education of Colorado 
A State- Wide recently decided to have given in all schoob of the state 
Uie of Educa- the following standardized tests: 

tional Tests Courtis Standard Research Tests in Arithmetic, Series B, 

Gray's Oral Reading Test, Gray's Silent Reading Test, 
Ayres Spelling Scale, Ayres Handwriting Scale, "Gettysburg Edition." 

At the present time the University of Colorado at Boulder, the State 
Teachers College at Greeley, and the State Normal School at Gunnison, are 
co-operating in conducting extension classes for Colorado teachers. For the 
western district of the state this work is in charge of Mr. O. B. Staples assisted 
by Dr. H. T. Manuel and Miss Stella Yowell. Mr. Staples writes as follows: 

''The Coimty Superintendents have been asked to direct this work (the 
testing program), and while they are struggling with it, those in my territory 
are quite unfamiliar with the technique of the work, and many of the teachers 
scarcely comprehend the significance of it, some of them not so much as ever 
having heard before of a ''Standard Test." But this action of the State 
Department has given the work large publicity, and Dr. Manuel and I are 
cooperating with the people in our territory, meeting them in groups, singly, 
etc., giving them such instruction, encouragement, etc., as we can to help 
them "put over" the program of the State Department, although we think it 
is being attempted in a very crude manner, and I fear somewhat the results 
may not be very helpful for a time. However, it is a start, and will doubtless 
lead to something definite later. 

"In our course we are using Monroe's Measuring the Results of Teaching 
as a text, and for the most part giving to the teachers themselves most of the 
tests discussed in this book. When the teachers seem familiar with a given 
test and the use of it, we have them give it in their schoob and then we secure 
their results, dbcuss them, and ask them to apply whatever suggestions we 
together may derive from such procedure." 

The state normal school at Gunnison has established a School Service 
Bureau which b serving the coimty superintendents and teachers of the state 
by supplying them with the testing material. In doing so, thb normal school 
b following a practice which has been found exceedingly worth while in other 
states. 



Nattmml Aaaonattiin nf ^ixtttotB of 

(E. J. AsHBAUGH, Secretary and Editor) 



Recently in talking with a gentleman who is greatly interested in the problems of 
educational research, he ventured the suggestion that most of our bureaus of educa- 
tional research were misnamed. He stated that he thought they should be named 
bureaus of accounting, since the work which was being done was almost, if not 
entirely, of an accounting nature rather than research. 

We wonder if the statement is true and if there is not a suggestion contained therein 
which will be beneficial to the members of our organization. Let each director of 
an organized bureau of educational research mentally review his work during the past 
year and consider whether or not it has been research or merely accounting. Has 
status alone been revealed? Have data been gathered, tabulated, and presented with- 
out careful analysis of the causal factors and the setting up of a definite remedial 
program? 

We fed that the work of bureaus of educational research is most vitaL We believe 
that the opportunities are practically limitless. We believe, also, that the present is 
critical and that the future of the movement for organized bureaus rests in the hands 
of those who are now directing such work. A few cities have established such bureaus 
and discontinued them because the school administration did not fed that the benefits 
derived were suffident to justify their continuance. At this stage of the development 
of the movement such failure is almost a calamity. Superintendents and teachers 
may fail and the schools will continue. The educational worid is accustomed to such 
failures. But we must not fail. We must not only discover status but also must reveal 
tendencies and causes. We must offer to the classroom teacher and the supervisory 
force definite constructive hdp in the solution of the problems which are revealed 
by measurement We must offer the administrators well-conceived programs based 
upon definite data which can [be presented to school boards and the public We 
must keep the scientific attitude but speak in terms of common knowledge. We must 
attack minute problems and carefully control conditions in our experiments, but keep 
ever in mind that teachers and the public want results in terms of the larger educa- 
tional progress. 

Unless bureaus of research can modify practice; unless they can offer constructive 
hdp all along the line; unless they can make teachers, supervisors, and administraton 
fed that their woHl is indispensable, they will faiL 

But we shall not fail. 



The applications for membership of four persons are before the executive commit- 
tee at this writing and others are going through the preliminary stage. Interest in the 
work of the association is certainly growing. Does any member know of a bureau 
anjrwhere which is not represented by membership? If so, he will please write to the 
secretary at once. 
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